Information processing device, information processing system, and information processing method

ABSTRACT

Appropriate control is performed when communication is performed between a plurality of information processing devices. 
     An information processing device performs real-time image transmission with another information processing device according to a Wi-Fi CERTIFIED Miracast specification. The information processing device includes a control unit. The control unit performs control such that setting request information for performing a setting related to the real-time image transmission is received from the other information processing device via an access point. The control unit performs control such that a setting request for performing the setting based on the setting request information is transmitted to the other information processing device through direct communication.

TECHNICAL FIELD

The present technology relates to an information processing device andmore particularly, to an information processing device, an informationprocessing system, and an information processing method in which variouskinds of information are exchanged using wireless communication.

BACKGROUND ART

In the related art, wireless communication technologies for exchangingvarious kinds of data using wireless communication are known. Forexample, information exchange devices that interchange various kinds ofinformation through wireless communication between two wirelesscommunication devices have been proposed (for example, see PatentLiterature 1).

CITATION LIST Patent Literature

Patent Literature 1: JP 2008-278388A

SUMMARY OF INVENTION Technical Problem

According to the above-described technologies of the related art,various kinds of information can be interchanged between two informationprocessing devices through wireless communication even when connectionis not established by wired lines. For example, an image based on imagedata transmitted from a transmission side information processing devicecan be displayed on a display unit of a reception side informationprocessing device.

Here, for example, when various kinds of information are interchangedbetween two information processing devices using wireless communication,a case in which communication is performed directly between the twoinformation processing devices and a case in which communication isperformed indirectly between the two information processing devices areassumed. Further, the case in which communication is performedindirectly between the two information processing devices includes, forexample, a case in which communication is performed indirectly betweenthe two information processing devices through another communicationdevice (for example, an access point or a base station).

For example, when communication is performed directly between the twoinformation processing devices, transition is assumed to be performed sothat communication is performed indirectly between the two informationprocessing devices. Further, when communication is performed indirectlybetween the two information processing devices, transition is assumed tobe performed so that communication is performed directly between the twoinformation processing devices. When switching of communication isperformed as described above, it is important to perform appropriatecontrol.

The present technology was made in light of the foregoing, and it is anobject of the present technology to perform appropriate control whencommunication is performed between a plurality of information processingdevices.

Solution to Problem

The present technology was made to solve the problem, and a first aspectthereof is an information processing device, an information processingmethod thereof, and a program for causing a computer to execute theinformation processing method, the information processing deviceperforming real-time image transmission with another informationprocessing device according to a wireless fidelity (Wi-Fi) CERTIFIEDMiracast specification (technical specification title: Wi-Fi Display),and including: a control unit configured to perform control such thatsetting request information for performing a setting related to thereal-time image transmission is received from the other informationprocessing device via an access point, and a setting request forperforming the setting based on the setting request information istransmitted to the other information processing device through directcommunication. Thus, there is an operation in which setting requestinformation is received from another information processing device viaan access point, and a setting request is transmitted to anotherinformation processing device through direct communication.

According to the first aspect, the control unit may interchangecapability information related to the information processing device withthe other information processing device via the access point. The otherinformation processing device may generate the setting requestinformation based on the capability information. Thus, there is anoperation in which capability information related to the informationprocessing device is interchanged with another information processingdevice via the access point, and another information processing devicegenerates the setting request information based on the capabilityinformation.

According to the first aspect, the control unit may perform control suchthat, when switching between a connection state with the otherinformation processing device via the access point and a connectionstate with the other information processing device through the directcommunication is performed, a connection process is performed using atleast one of port information and IP information related to a connectionbefore the switching. Thus, there is an operation in which, whenswitching between a connection state with another information processingdevice via the access point and a connection state with anotherinformation processing device through the direct communication isperformed, a connection process is performed using at least one of portinformation and IP information related to a connection before theswitching.

According to the first aspect, the control unit may perform control suchthat image transmission according to the Wi-Fi CERTIFIED Miracastspecification is performed through the direct communication after thesetting request is transmitted to the other information processingdevice. Thus, there is an operation in which the image transmissionaccording to the Wi-Fi CERTIFIED Miracast specification is performedthrough the direct communication after the setting request istransmitted to another information processing device.

According to the first aspect, the control unit may perform control suchthat an image displayed on a predetermined region in a display unit istransmitted through a wireless transmission path of a low frequencyband, and an image displayed on a region larger than the predeterminedregion in the display unit is transmitted through a wirelesstransmission path of a high frequency band. Thus, there is an operationin which an image displayed on a predetermined region in a display unitis transmitted through a wireless transmission path of a low frequencyband, and an image displayed on a region larger than the predeterminedregion in the display unit is transmitted through a wirelesstransmission path of a high frequency band.

According to the first aspect, the control unit may perform control suchthat the setting request is transmitted to the other informationprocessing device through the direct communication based on amanipulation of a user. Thus, there is an operation in which the settingrequest is transmitted to another information processing device throughthe direct communication based on a manipulation of a user.

According to the first aspect, the control unit may perform control suchthat, when there are a plurality of information processing devicesconfigured to perform image transmission through the directcommunication, the setting request is transmitted to the otherinformation processing device through the direct communication based ona predetermined order. Thus, there is an operation in which, when thereare a plurality of information processing devices configured to performthe image transmission through the direct communication, the settingrequest is transmitted to another information processing device throughthe direct communication based on a predetermined order.

According to the first aspect, the control unit may perform control suchthat permission information indicating whether or not a connection withthe other information processing device via an access point other thanthe access point or a base station is permitted is interchanged via theaccess point, and when the permission information indicating that theconnection is permitted is received, an interchange with the otherinformation processing device via the access point other than the accesspoint or the base station is performed. Thus, there is an operation inwhich permission information is interchanged via the access point, andwhen the permission information indicating that the connection ispermitted is received, an interchange with another informationprocessing device via another access point or a base station isperformed.

According to the first aspect, the control unit may perform control suchthat, when the permission information indicating that the connection ispermitted is received, at least one of image data and audio data isreceived from the other information processing device via the accesspoint other than the access point or the base station and output. Thus,there is an operation in which, when the permission informationindicating that the connection is permitted is received, at least one ofimage data and audio data is received from another informationprocessing device via another access point or a base station and output.

According to the first aspect, the control unit may perform control suchthat information for performing the direct communication is interchangedusing near field communication. Thus, there is an operation in whichinformation for performing the direct communication is interchangedusing near field communication.

A second aspect of the present technology is an information processingdevice, an information processing method thereof, and a program forcausing a computer to execute the information processing method, theinformation processing device performing real-time image transmissionwith another information processing device according to a Wi-FiCERTIFIED Miracast specification, and including: a control unitconfigured to perform control such that setting request information forperforming a setting related to the real-time image transmission istransmitted to the other information processing device via an accesspoint, and a setting request for performing the setting based on thesetting request information is received from the other informationprocessing device through direct communication. Thus, there is anoperation in which setting request information is transmitted to anotherinformation processing device via an access point, and a setting requestis received from another information processing device through directcommunication.

A third aspect of the present technology is an information processingdevice, an information processing method thereof, and a program forcausing a computer to execute the information processing method, theinformation processing device including: a control unit configured toperform control such that, when real-time image transmission isperformed between a sink device and a plurality of source devicesaccording to a Wi-Fi CERTIFIED Miracast specification, any onecommunication mode of a standby mode in which the sink device and thesource devices are connected via an access point and an imagetransmission mode in which the sink device and the source devices areconnected through direct communication is set in the source devices.Thus, there is an operation in which any one communication mode betweena standby mode and an image transmission mode is set in a source device.

According to the third aspect, the control unit may perform control suchthat an image indicating the plurality of source devices is displayed onan input and output unit, and the communication mode is set in thesource device based on an manipulation input in the input and outputunit. Thus, there is an operation in which an image indicating aplurality of source devices is displayed on an input and output unit,and the communication mode is set in the source device based on amanipulation input in the input and output unit.

According to the third aspect, the control unit may perform control suchthat the communication mode is set in the source device based on apredetermined order. Thus, there is an operation in which thecommunication mode is set in the source device based on a predeterminedorder.

A fourth aspect of the present technology is an information processingsystem, an information processing method thereof, and a program forcausing a computer to execute the information processing method, theinformation processing system including: a sink device configured toperform real-time image transmission with a source device according to aWi-Fi CERTIFIED Miracast specification and perform control such that asetting request information for causing the source device to perform asetting related to the real-time image transmission is transmitted tothe source device via an access point, and a setting request forperforming the setting based on the setting request information isreceived from the source device through direct communication with thesource device; and a control device configured to perform control suchthat, when the real-time image transmission is performed between thesink device and the plurality of source devices, any one communicationmode of a standby mode in which the sink device and the source devicesare connected via the access point and an image transmission mode inwhich the sink device and the source devices are connected through thedirect communication is set in the source devices. Thus, there is anoperation in which a sink device transmits setting request informationto a source device via an access point and receives a setting requestfrom the source device through direct communication, and a controldevice sets any one communication mode between a standby mode and animage transmission mode in the source device.

Advantageous Effects of Invention

According to the present technology, an excellent effect thatappropriate control can be performed when communication is performedbetween a plurality of information processing devices can be obtained.The effect described herein is not necessarily limited, and any effectdescribed in the present disclosure may be included.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating a system configuration example ofa communication system 100 according to a first embodiment of thepresent technology.

FIG. 2 is a block diagram illustrating a functional configurationexample of an information processing device 200 according to the firstembodiment of the present technology.

FIG. 3 is a block diagram illustrating a functional configurationexample of an information processing device 300 according to the firstembodiment of the present technology.

FIG. 4 is a diagram schematically illustrating a content exampleretained in a management information retention unit 390 according to thefirst embodiment of the present technology.

FIG. 5 is a diagram illustrating a transition example of imagesdisplayed on a display unit 351 of the information processing device 300according to the first embodiment of the present technology.

FIG. 6 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 7 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 8 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 9 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 10 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 11 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 100 according tothe first embodiment of the present technology.

FIG. 12 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 200 according to the first embodiment of the present technology.

FIG. 13 is a flowchart illustrating an example of a processing procedureof a data transmission speed control process performed by theinformation processing device 300 according to the first embodiment ofthe present technology.

FIG. 14 is a sequence chart illustrating a communication process examplebetween a source device and a sink device according to the firstembodiment of the present technology.

FIG. 15 is a sequence chart illustrating a communication process examplebetween a source device and a sink device according to the firstembodiment of the present technology.

FIG. 16 is a sequence chart illustrating a communication process examplebetween a source device and a sink device according to the firstembodiment of the present technology.

FIG. 17 is a diagram illustrating a system configuration example of acommunication system 700 according to the second embodiment of thepresent technology.

FIG. 18 is a diagram illustrating an installation example of acommunication system 700 according to the second embodiment of thepresent technology.

FIG. 19 is a block diagram illustrating a functional configurationexample of a control device 740 according to the second embodiment ofthe present technology.

FIG. 20 is a diagram schematically illustrating a content exampleretained in a group management information retention unit 750 accordingto the second embodiment of the present technology.

FIG. 21 is a diagram illustrating an example of a display screendisplayed on an input and output unit 743 of the control device 740according to the second embodiment of the present technology.

FIG. 22 is a diagram illustrating a transition example of a displayscreen displayed on a display device 731 according to the secondembodiment of the present technology.

FIG. 23 is a diagram illustrating a switching example of a communicationmode between a source device and a sink device serving as a basis forthe present technology.

FIG. 24 is a sequence chart illustrating a connection process examplebetween a source device and a sink device according to the secondembodiment of the present technology.

FIG. 25 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 700 according tothe second embodiment of the present technology.

FIG. 26 is a sequence chart illustrating a communication process examplebetween devices included in the communication system 700 according tothe second embodiment of the present technology.

FIG. 27 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the second embodiment of the present technology.

FIG. 28 is a diagram illustrating a usage example of the informationprocessing device 710 according to the second embodiment of the presenttechnology.

FIG. 29 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the second embodiment of the present technology.

FIG. 30 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the second embodiment of the present technology.

FIG. 31 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the third embodiment of the present technology.

FIG. 32 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the fourth embodiment of the present technology.

FIG. 33 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the fourth embodiment of the present technology.

FIG. 34 is a diagram illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 35 is a diagram illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 36 is a diagram illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 37 is a diagram illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 38 is a diagram illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 39 is a diagram illustrating an example of a new message for anapplication service platform (ASP) interchanged between devices includedin the communication system 700 according to the second embodiment ofthe present technology.

FIG. 40 is a block diagram illustrating an example of a schematicconfiguration of a smartphone.

FIG. 41 is a block diagram illustrating an example of a schematicconfiguration of a car navigation device.

DESCRIPTION OF EMBODIMENT(S)

Hereinafter, modes (hereinafter, “embodiments”) for carrying out thepresent technology will be described. The description will proceed inthe following order:

1. First embodiment (example of controlling wireless communication basedon user information or management information)

2. Second embodiment (example of switching connection between sourcedevice and sink device via access point and direct connection betweensource device and sink device)

3. Third embodiment (example of starting group authentication betweensource device and sink device using near field communication)

4. Fourth embodiment (example in which source device is automaticallyconnected to access point or sink device)

5. Application examples

1. First Embodiment Configuration Example of Communication System

FIG. 1 is a block diagram illustrating a system configuration example ofa communication system 100 according to a first embodiment of thepresent technology.

The communication system 100 includes information processing devices200, 300, and 400. The communication system 100 is a communicationsystem in which the information processing device 300 receives data (forexample, image data or audio data) transmitted from at least one of theinformation processing devices 200 and 400.

The information processing devices 200, 300, and 400 are transmissionand reception devices that have a wireless communication function. Theinformation processing devices 200, 300, and 400 are, for example,display devices (for example, personal computers) or portableinformation processing devices (for example, smartphones or tabletterminals) that have a wireless communication function. The informationprocessing devices 200, 300, and 400 are, for example, wirelesscommunication devices that conform to Institute of Electrical andElectronics Engineers (IEEE) 802.11, 802.15, or 802.16, 3rd GenerationPartnership Project (3GPP) specification (for example, Wideband CodeDivision Multiple Access (W-CDMA)), Global system for MobileCommunications (GSM: registered trademark), Worldwide Interoperabilityfor Microwave Access (WiMAX), WiMAX2, Long Term Evolution (LTE), LTE-A(Advanced), or the like. The information processing devices 200, 300,and 400 can interchange various kinds of information using the wirelesscommunication function.

Here, an example of a case in which wireless communication usingwireless Local Area Network (LAN) is performed between the informationprocessing devices 200 and 300 or between the information processingdevices 400 and 300 will be described.

As the wireless LAN, for example, Wireless Fidelity (Wi-Fi) Direct,Tunneled Direct Link Setup (TDLS), an ad-hoc network, or a mesh networkcan be used. As short-range wireless audio visual (AV) transmissioncommunication used in the communication system 100, for example, Wi-FiCertified Miracast (technical specification title: Wi-Fi Display) can beused. Wi-Fi Certified Miracast is a mirroring technology fortransmitting an audio or a display image reproduced with one terminal toanother terminal using the technology of Wi-Fi Direct or TDLS andoutputting the audio or image data similarly with the other terminal.

In Wi-Fi Certified Miracast, user Input Back Channel (UIBC) is realizedon Transmission Control Protocol/Internet Protocol (TCP/IP). UIBC is atechnology for transmitting manipulation information of an input devicesuch as a mouse or a keyboard from one terminal to another terminal.Instead of Wi-Fi Certified Miracast, another remote desktop software(for example, Virtual Network Computing (VNC)) may be applied.

Here, in Wi-Fi Certified Miracast, for example, it is established thatan image (video) is compressed and decompressed using H.264. Forexample, in Wi-Fi Certified Miracast, H.264 can be adjusted on atransmission side. An embodiment of the present technology is notlimited to H.264, but can also correspond to various codecs such asH.265 (for example, high efficiency video coding (HEVC) and scalablevideo coding extensions of high efficiency video coding (SHVC)) andMoving Picture Experts Group (MPEG4), Joint 1 Photographic Experts Group(JPEG) 2000. Further, it can also correspond to a line-based codec inwhich one or more lines are bundled and compressed or two or more linesare divided into 2×2 or more macro blocks to be compressed anddecompressed. For example, by obtaining a difference with a previouscode amount region of a specific code amount region (such as a picture,a bundle of a plurality of lines, or a macro block), it is possible tocorrespond to a codec that reduces a transmission rate withoutperforming compression such as DCT or Wavelet. Further, an image (video)may be transmitted or received with non-compression.

In the first embodiment of the present technology, an example in whichthe information processing device 200 sets image data and audio datagenerated through an imaging operation as a transmission target will bedescribed. In the first embodiment of the present technology, an examplein which the information processing device 400 sets content (forexample, content formed by image data and audio data) stored in astorage unit (for example, a hard disk) as a transmission target. Anelectronic device (for example, a PC, a game device, a smartphone, or atablet terminal) on which a camera is mounted as the informationprocessing device 200 may be used. Another electronic device (forexample, an imaging device, a game device, a smartphone, or a tabletterminal) that includes a display unit as the information processingdevice 300 may be used. If the information processing device 400 has atethering function, the information processing device 400 may acquirecontent stored in an internet services provider (IPS) via wireless orwired network and set the content as a transmission target.

For example, image data generated through an imaging operation of theinformation processing device 200 is transmitted to the informationprocessing device 300 and an image 11 based on the image data isdisplayed on a display unit 351 of the information processing device300. Further, content stored in a storage unit (for example, a harddisk) of the information processing device 400 is transmitted to theinformation processing device 300 and an image 12 based on this contentis displayed on the display unit 351 of the information processingdevice 300.

In this way, in the first embodiment of the present technology, anexample in which the information processing devices 200 and 400 serve assource side information processing devices (source devices) and theinformation processing device 300 serves as a sink side informationprocessing device (sink device) will be described.

In FIG. 1, a range in which the information processing device 300 canperform direct communication via peer to peer (P2P) direct connectionusing wireless communication is indicated as an information transferrange 101. The information transfer range 101 is an information transferrange (a service range) based on the information processing device 300.

Configuration Example of Information Processing Device (Source Device)

FIG. 2 is a block diagram illustrating a functional configurationexample of the information processing device 200 according to the firstembodiment of the present technology. The functional configuration ofthe information processing device 400 related to wireless communicationis substantially the same as that of the information processing device200. Therefore, in the first embodiment of the present technology, onlythe information processing device 200 will be described and thedescription of the information processing device 400 will be omitted.

The information processing device 200 includes an antenna 210, awireless communication unit 220, a control signal reception unit 230, acontrol unit 240, an image and audio signal generation unit 250, animage and audio compression unit 260, and a stream transmission unit270.

The wireless communication unit 220 transmits and receives each piece ofinformation (for example, image data and audio data) to and from anotherinformation processing device (for example, the information processingdevice 300) via the antenna 210 using wireless communication under thecontrol of the control unit 240. For example, when an image datatransmission process is performed, the image data generated by the imageand audio signal generation unit 250 is compressed by the image andaudio compression unit 260 and the compressed image data (image stream)is transmitted from the antenna 210 via the wireless communication unit220.

The wireless communication unit 220 is assumed to be able to transmitand receive each piece of information to and from another informationprocessing device (for example, the information processing device 300)using a plurality of frequency channels. In the first embodiment of thepresent technology, an example in which the wireless communication unit220 has a function of transmitting and receiving three kinds offrequency channels, 2.4 GHz, 5 GHz, and 60 GHz will be described. Inthis way, when the source device has the function of transmitting andreceiving the plurality of frequency channels, a sink device (forexample, the information processing device 300) can control a frequencychannel to be used by each source device.

The control signal reception unit 230 acquires a control signal (forexample, information interchanged with the information processing device300) transmitted from another information processing device (forexample, the information processing device 300) among the pieces ofinformation received by the wireless communication unit 220. Then thecontrol signal reception unit 230 outputs the acquired control signal tothe control unit 240.

The control unit 240 performs control on each piece of information to betransmitted from the information processing device 200. For example, thecontrol unit 240 performs control on the image and audio signalgeneration unit 250 and the image and audio compression unit 260 basedon the control signal received by the control signal reception unit 230.For example, the control unit 240 performs control such that the numberof channels of audio or the resolution of image data which is atransmission target is changed or performs control such that an imageregion of the image data which is a transmission target is changed. Thatis, the control unit 240 performs transmission control of a stream (forexample, data transmission speed control, scalability transmission ratecontrol) which is a transmission target based on the control signalreceived by the control signal reception unit 230.

The control unit 240 may have a function of measuring a radio wavepropagation situation (link radio wave propagation situation) when datais transmitted to and received from the sink device using the wirelesscommunication and may transmit a measurement result (radio wavepropagation measurement information) to the sink device.

Here, the radio wave propagation measurement information is, forexample, information used to determine whether line quality with thesink device is quality with which the image data and the audio data canbe transmitted and received. The radio wave propagation measurementinformation is used, for example, when stream transmission control (forexample, the data transmission speed control, the scalabilitytransmission rate control) is performed. The radio wave propagationmeasurement information will be described in detail with reference toFIG. 4. Instead of the radio wave propagation measurement information,the control unit 240 may count the number of retransmissions of the samepacket and perform the stream transmission control corresponding to thecounted number of retransmissions.

Here, the data transmission speed mainly means an occupancy ratio to acommunication line and is assumed to include a meaning of acommunication speed or a communication capacity. For example, theresolution is defined as an index of image quality configured to includea component such as an image frame (the number of vertical andhorizontal pixels) of the image data, or a bit rate (compression ratio)of the image data. As the index of the quality, the throughput of astream can be used. The number of channels of audio is assumed toinclude a meaning of an audio recording and reproducing method such as amonaural (1.0 ch) or a stereo (2.0 ch). The number of channels of audiois defined as an index of audio quality configured to include acomponent such as a bit rate (compression ratio) of audio data or thenumber of channels. As the index of the audio quality, the throughput ofa stream can be used.

The control unit 240 performs control such that a state unstable in thedata rate control is improved. For example, the control unit 240comprehends system performance information of a sink device (forexample, the information processing device 300) by interchanginginformation with the sink device. Here, the system performanceinformation is, for example, performance information regarding thesystem of the sink device. For example, the system performanceinformation is a usable frequency channel, a resolution, TransmissionControl Protocol (TCP), and User Datagram Protocol (UDP). The systemperformance information is, for example, information indicating each ofcorrespondence of an encryption method, correspondence of standarddefinition (SD)/high definition (HD), and correspondence of a low powerconsumption mode. For example, the control unit 240 can select a methodfor the stream transmission control (for example, the data transmissionspeed control and the scalability transmission rate control) to furtherimprove the entire system stability of the communication system 100according to whether the sink device corresponds to the lower powerconsumption mode.

For example, the control unit 240 is assumed to insert informationregarding whether the information processing device 200 is a mobiledevice during interchange of information with the information processingdevice 300. For example, capability information regarding theinformation processing device 200 can include information regardingwhether the information processing device 200 is a mobile device. Whenit is comprehended that the information processing device 200 is themobile device, the information processing device 300 can determine thatit is not necessary to operate the information processing device 200based on association with other connected information processingdevices. In this way, when it is determined that it is not necessary tooperate the information processing device 200, the informationprocessing device 200 receives a transmission stop command from theinformation processing device 300. When the control unit 240 comprehendsthe transmission stop command, the control unit 240 can be powered downthe function of each of the image and audio signal generation unit 250,the image and audio compression unit 260, and the stream transmissionunit 270 for a given time. The control unit 240 can transition thewireless communication unit 220 to intermittent reception (which is amode in which the wireless communication unit 220 rises up periodicallyso that the wireless communication unit 220 can receive a command fromthe information processing device 300 and the device is powered down inother cases).

The image and audio signal generation unit 250 generates data (imagedata and audio data) which is an output target under the control of thecontrol unit 240 and outputs the generated data to the image and audiocompression unit 260. For example, the image and audio signal generationunit 250 includes an imaging unit (not illustrated) and an audioacquisition unit (not illustrated). The imaging unit (for example, alens, an image sensor, or a signal processing circuit) images a subjectand generates an image (image data). The audio acquisition unit (forexample, a microphone) acquires a surrounding audio when the image datais generated. The data generated in this way is a transmission target tobe transmitted to another information processing device (for example,the information processing device 300).

The image and audio compression unit 260 compresses (encodes) the data(the image data and the audio data) generated by the image and audiosignal generation unit 250 under the control of the control unit 240.Then, the image and audio compression unit 260 outputs the compresseddata (the image data and the audio data) to the stream transmission unit270. The image and audio compression unit 260 may be realized byperforming the encoding by software or may be realized by performing theencoding by hardware. The image and audio compression unit 260 isassumed to function as a codec, but is assumed to be able to handle anuncompressed image or audio. Further, the image and audio compressionunit 260 can also function as a scalable codec. Here, the scalable codecmeans, for example, a codec which can be applied freely according to theresolution of a reception side information processing device (sinkdevice), a network environment, or the like.

The stream transmission unit 270 performs a transmission process oftransmitting the data (the image data and the audio data) compressed bythe image and audio compression unit 260 as a stream from the antenna210 via the wireless communication unit 220 under the control of thecontrol unit 240.

The information processing device 200 can include a display unit, anaudio output unit, and a manipulation reception unit in addition to theabove-described units, but these units are not illustrated in FIG. 2.The example in which the information processing device 200 generates theimage data and the audio data which are the transmission targets hasbeen described. However, the information processing device 200 mayacquire image data and audio data which are transmission targets from anexternal device. For example, the information processing device 200 mayacquire image data and audio data which are transmission targets from aweb camera equipped with a microphone. The information processing device200 may set content (for example, content formed by image data and audiodata) stored in a storage device (for example, a hard disk) as atransmission target irrespective of the inside or outside of theinformation processing device 200. In this case, the content stored inthe storage device is also assumed to be compressed content. In thiscase, when the compressed content is compressed in accordance with anencoding scheme defined in a standard adopted in the communicationsystem 100, the compressed content may be transmitted without beingdecrypted (decoded).

A display unit (not illustrated) of the information processing device200 is, for example, a display unit that displays an image generated bythe image and audio signal generation unit 250. As the display unit, forexample, a display panel such as an electro-luminescence (EL) or crystallight-emitting diode (LED) display or a liquid crystal display (LCD) canbe used.

An audio output unit (not illustrated) of the information processingdevice 200 is, for example, an audio output unit (for example, aspeaker) that outputs an audio generated by the image and audio signalgeneration unit 250. An image can be output from both of a transmissiondevice and a reception device, but an audio is preferably output fromonly one of the transmission device and the reception device.

A manipulation reception unit (not illustrated) of the informationprocessing device 200 is a manipulation reception unit that receives amanipulation input performed by a user and is, for example, a keyboard,a mouse, a game pad, a touch panel, a camera, or a microphone. Themanipulation reception unit and the display unit can be integrallyconfigured using a touch panel capable of performing a manipulationinput when the user touches or approaches a display surface with his orher finger.

Configuration Example of Information Processing Device (Sink Side)

FIG. 3 is a block diagram illustrating a functional configurationexample of the information processing device 300 according to the firstembodiment of the present technology.

The information processing device 300 includes an antenna 310, awireless communication unit 320, a stream reception unit 330, an imageand audio decompression unit 340, an image and audio output unit 350, auser information acquisition unit 360, a control unit 370, a controlsignal transmission unit 380, and a management information retentionunit 390.

The wireless communication unit 320 transmits and receives each piece ofinformation (for example, image data and audio data) to and from anotherinformation processing device (for example, the information processingdevice 200) via the antenna 310 using wireless communication under thecontrol of the control unit 370. For example, when an image datareception process is performed, the image data received by the antenna310 is decompressed (decoded) by the image and audio decompression unit340 via the wireless communication unit 320 and the stream receptionunit 330. Then, the decompressed image data is supplied to the image andaudio output unit 350 and an image according to the decompressed imagedata is output from the image and audio output unit 350. That is, theimage according to the decompressed image data is displayed on a displayunit 351.

The wireless communication unit 320 is assumed to be able to transmitand receive each piece of information to and from another informationprocessing device (for example, the information processing device 200)using a plurality of frequency channels. In the first embodiment of thepresent technology, an example in which the wireless communication unit320 has a function of transmitting and receiving three kinds offrequency channels, 2.4 GHz, 5 GHz, and 60 GHz will be described. Thatis, the wireless communication unit 320 can perform communication usinga first frequency band and communication using a second frequency bandof a higher data transmission speed than the first frequency band. Thecontrol unit 370 controls a frequency channel to be used among aplurality of frequency channels in wireless communication with eachsource device.

Link between the information processing devices 200 and 300 and linkbetween the information processing devices 400 and 300 may beestablished with the same frequency channel or may be established withdifferent frequency channels.

In the first embodiment of the present technology, an example in whichthe wireless communication unit 320 has the function of transmitting andreceiving three kinds of frequency channels, 2.4 GHz, 5 GHz, and 60 GHzwill be described, but an embodiment of the present technology is notlimited thereto. For example, the wireless communication unit 320 mayhave a function of transmitting and receiving other frequency channels,two frequency channels, four or more frequency channels.

The stream reception unit 330 receives streams (for example, an imagestream and an audio stream) and interchange information with each sourcedevice among the pieces of information received by the wirelesscommunication unit 320 under the control of the control unit 370. Then,the stream reception unit 330 outputs the received command informationto the control unit 370 and outputs the received streams to the imageand audio decompression unit 340 and the control unit 370.

Here, the interchange information with each source device is informationtransmitted from a source device (for example, the informationprocessing device 200) and includes, for example, a request foracquiring system performance information of the information processingdevice 300. The system performance information is, for example,information indicating a usable frequency channel, a resolution, TCP,and UDP or each of correspondence of an encryption method,correspondence of SD/HD, and correspondence of a low power consumptionmode.

The stream reception unit 330 has a function of measuring a radio wavepropagation situation (link radio wave propagation situation) when datais transmitted to and received from a sink device using the wirelesscommunication. The stream reception unit 330 outputs a measurementresult (radio wave propagation measurement information) to the controlunit 370. The radio wave propagation measurement information will bedescribed in detail with reference to FIG. 4.

The image and audio decompression unit 340 decompresses (decodes) thestreams (image data and the audio data) transmitted from anotherinformation processing device (for example, the information processingdevice 200) under the control of the control unit 370. Then, the imageand audio decompression unit 340 outputs the decompressed data (theimage data and the audio data) to the image and audio output unit 350.The image and audio decompression unit 340 may be realized by performingthe decoding by software or may be realized by performing the decodingby hardware. The image and audio decompression unit 340 is assumed tofunction as a codec, but is assumed to be able to handle an uncompressedimage or audio. Further, the image and audio decompression unit 340 canalso function as a scalable codec.

The image and audio output unit 350 includes a display unit 351 and anaudio output unit 352.

The display unit 351 is a display unit that displays each image (forexample, the images 11 and 12 illustrated in FIG. 1) based on the imagedata decompressed by the image and audio decompression unit 340. As thedisplay unit 351, for example, a display panel such as an organic ELpanel, a crystal LED display, an LCD panel can be used. As the displayunit 351, a touch panel capable of performing a manipulation input whena user touches or approaches a display surface with his or her fingermay be used.

The audio output unit 352 is an audio output unit (for example, aspeaker) that outputs various audios (an audio and the like related toan image displayed on the display unit 351) based on the audio datadecompressed by the image and audio decompression unit 340. Here, as anaudio output method, for example, a method of reproducing only an audioof a source device allocated to a middle channel (a main image) from aspeaker and reproducing no audio of a source device allocated to aperipheral channel (a sub-image) can be used. As another audio outputmethod, for example, a method of setting the volume of an audio of asource device allocated to the middle channel as a main and lowering thevolume of an audio of a source device allocated to the peripheralchannel and reproducing the audio can be used. Other audio outputmethods may be used.

The user information acquisition unit 360 acquires information regardinga user (user information) and outputs the acquired user information tothe control unit 370. For example, the user information acquisition unit360 can acquire the user information by receiving an input from amanipulation reception unit (a keyboard, a mouse, a remote controller, agame pad, or a touch panel) for which the user can directly set adisplay method. The manipulation reception unit is, for example, amanipulation member that designates any region in an image displayed onthe display unit 351. For example, the user information acquisition unit360 can acquire the user information by receiving an input from a devicewhich can comprehend a user's intention, such as a camera, a microphone,or any of various sensors (for example, gyro sensors and sensorsdetecting human bodies).

For example, the user information acquisition unit 360 acquires the userinformation generated through a user motion when information based onthe stream received from another information processing device (forexample, the information processing device 200) using the wirelesscommunication is output from the image and audio output unit 350. Theuser information is, for example, user information generated through auser motion related to an image displayed on the display unit 351. Forexample, the user information is information generated based on a usermanipulation related to the image displayed on the display unit 351.

The control unit 370 causes the management information retention unit390 to retain each piece of information acquired by the stream receptionunit 330 and manages each source device based on management informationretained the management information retention unit 390. The control unit370 performs the stream transmission control (for example, the datatransmission speed control, and the scalability transmission ratecontrol) so that stability is improved for streams transmitted from aplurality of source devices in the entire system.

For example, the control unit 370 performs the stream transmissioncontrol (for example, the data transmission speed control and thescalability transmission rate control) based on the user informationacquired by the user information acquisition unit 360 and the managementinformation retained in the management information retention unit 390.Specifically, the control unit 370 generates a control signal for eachsource device to perform the stream transmission control (for example,the data transmission speed control and the scalability transmissionrate control) based on the management information retained in themanagement information retention unit 390 and outputs the generatedcontrol signal to the control signal transmission unit 380. For example,the control unit 370 changes the resolution of an image displayed on thedisplay unit 351 based on the user information and the managementinformation and generates a control signal to request a transmissionrate equivalent to the resolution to each source device. For example,the control unit 370 generates a control signal to change a displayregion of an image on the display unit 351 based on the user informationand the management information. For example, the control unit 370generates a control signal to change the size of an image on the displayunit 351 based on the user information and the management information.

The control unit 370 performs control such that a frequency channel anda resolution to be used are set based on the user information and themanagement information. For example, the control unit 370 sets afrequency channel to be used for each source device in the plurality offrequency channels of the wireless communication unit 320. When thepower consumption mode is different from each frequency channel, thecontrol unit 370 comprehends each mode and sets the frequency channelfor caring the power consumption of a mobile device. That is, thecontrol unit 370 can separately set a first power consumption moderelated to the first frequency band and a second power consumption moderelated to the second frequency band of a higher data transmission speedthan the first frequency band.

The control signal transmission unit 380 performs a transmission processof transmitting the control signal output from the control unit 370 toanother wireless communication device via the wireless communicationunit 320 and the antenna 310.

The management information retention unit 390 is a table that retainsinformation (management information) to manage each source deviceconnected to the information processing device 300 using the wirelesscommunication. Content retained in the management information retentionunit 390 will be described in detail with reference to FIG. 4.

Content Example Retained in Management Information Retention Unit

FIG. 4 is a diagram schematically illustrating a content exampleretained in the management information retention unit 390 according tothe first embodiment of the present technology.

The management information retention unit 390 is a table that retainsinformation (management information) to manage each source deviceconnected to the information processing device 300 using the wirelesscommunication. For example, in the management information retention unit390, terminal identification information 391, a frequency channel 392, aradio wave propagation measurement information 393, device information394, a band use level 395, a display form 396, standby or wake-up 397,and multi-reception diversity correspondence 398 are retained inassociation therewith.

In the terminal identification information 391, identificationinformation is stored to identify the source devices connected to theinformation processing device 300 using the wireless communication.

In the frequency channel 392, a frequency channel actually used by thesource device connected to the information processing device 300 usingthe wireless communication is stored.

In the radio wave propagation measurement information 393, radio wavepropagation measurement information regarding the source deviceconnected to the information processing device 300 using the wirelesscommunication is stored. The radio wave propagation measurementinformation is measured by the stream reception unit 330 for each sourcedevice connected to the information processing device 300 using thewireless communication.

As the radio wave propagation measurement information 393, for example,a packet error rate (PER), a bit error rate (BER), the number ofretransmissions of packets, and a throughput are stored. As the radiowave propagation measurement information 393, for example, frame drop, asignal to interference ratio (SIR), and a received signal strengthindicator (RSSI) are stored. Here, instead of the SIR, a signal tointerference plus noise ratio (SINR) may be used. The radio wavepropagation measurement information 393 illustrated in FIG. 4 is anexample. At least one piece of information among the pieces ofinformation may be stored or another piece of radio wave propagationmeasurement information may be measured by the stream reception unit 330to be stored. The radio wave propagation measurement informationmeasured by the source device may be acquired and stored. Packet delayreceived by a reception side may be determined and information regardingthe packet delay may be used as radio wave propagation measurementinformation. The packet delay serves as one index related to radio wavepropagation since delay occurs in transmission to the reception sidethrough a retransmission process in layer 2 at the time of occurrence ofan error. The packet delay serves as, for example, an index indicatingwhere link characteristics deteriorate in a wireless system in which aplurality of devices share wireless bands.

In the device information 394, classification of the source device (anattribute of the source device) connected to the information processingdevice 300 using the wireless communication is stored. For example,either of a mobile device and a stationary device is stored as theclassification of the source device. Either of a device of which a powersource is inserted and another device may be stored as theclassification of the source device. Either of a battery-driven deviceand another device may be stored as the classification of the sourcedevice.

In the band use level 395, a band use level of the source deviceconnected to the information processing device 300 using the wirelesscommunication is stored. As the band use level, for example, aresolution or a throughput can be used. For example, in the band uselevel, a throughput during use may be stored, a pre-decided table may beprepared, and a number indicating correspondence of a range of the tablemay be stored and managed.

In the display form 396, a data display form (an output form) based on astream transmitted from the source device connected to the informationprocessing device 300 using the wireless communication is stored. Forexample, a display form (a main image (a middle channel) or a sub-image(a peripheral channel)) of the image data which is displayed on thedisplay unit 351 and which is based on the stream transmitted from thesource device is stored. For example, an output form (a main audio or asub-audio) of the audio data which is output from the audio output unit352 and which is based on the stream transmitted from the source deviceis stored. A format in which the peripheral channel is not displayed maybe realized in accordance with the display form.

In the standby or wake-up 397, a mode (a standby mode or a wake-up mode)of the source device connected to the information processing device 300using the wireless communication is stored. The standby mode and thewake-up mode will be described in detail with reference to FIGS. 6 to 8.

In the multi-reception diversity correspondence 398, informationindicating whether the source device connected to the informationprocessing device 300 using the wireless communication corresponds tothe multi-reception diversity is stored.

In this way, the management information retained in the managementinformation retention unit 390 is information for associating theidentification information (the terminal identification information 391)used to identify the other information processing device with thecapability information regarding the other information processing devicefor management. The management information retained in the managementinformation retention unit 390 includes at least the information (theradio wave propagation measurement information 393) regarding the radiowave propagation measurement related to the communication with the otherinformation processing device and the information (the standby orwake-up 397) regarding power consumption as the capability informationregarding the other information processing device. The managementinformation retained in the management information retention unit 390includes the information (the display form 396) regarding a display formfor displaying the image information as the capability informationregarding the other information processing device. The informationregarding the display form is, for example, information indicating thatthe image information is displayed as main information orsub-information.

Transition Example of Image

FIG. 5 is a diagram illustrating a transition example of imagesdisplayed on the display unit 351 of the information processing device300 according to the first embodiment of the present technology.

FIG. 5a illustrates an example of a display form in which the images 11and 12 are displayed on the display unit 351 of the informationprocessing device 300 by setting the image 11 as a middle channel andsetting the image 12 as a peripheral channel.

FIG. 5b illustrates an example of a display form in which the images 11and 12 are displayed on the display unit 351 of the informationprocessing device 300 by setting the image 11 as a peripheral channeland setting the image 12 as a middle channel.

For example, a case in which each of the information processing devices200 and 400 transmits a stream (the image data and the audio data) witha standard resolution to the information processing device 300 isassumed. In this case, as illustrated in FIG. 1, the image 11 based onthe image data from the information processing device 200 and the image12 based on the image data from the information processing device 400can be displayed on the display unit 351 of the information processingdevice 300 so that the sizes of the images 11 and 12 are the same. Inthis example, a given resolution and a display region are defined to bethe same, but a scaler function may be added to the display unit 351 sothat the images 11 and 12 are rescaled and displayed on the display unit351. However, in the embodiments of the present technology, tofacilitate the description, this function is assumed not to be used inthe description.

In the display forms of the images 11 and 12, for example, the displayforms set at the time of the previous communication may be retained andthe images 11 and 12 may be displayed on the display unit 351 of theinformation processing device 300 according to the display forms.

The display forms of the images 11 and 12 may be decided based on anorder of connection to the information processing device 300. Forexample, a case in which the information processing device 200 is firstconnected to the information processing device 300 and the informationprocessing device 400 is connected to the information processing device300 after the connection is assumed. In this case, the images 11 and 12are displayed on the display unit 351 of the information processingdevice 300 by setting the image 11 as the middle channel and setting theimage 12 as the peripheral channel. That is, the images may be displayedin the procedure of the middle channel and the peripheral channel basedon the order of the connection to the information processing device 300.

As illustrated in FIG. 5a , when the images 11 and 12 are displayed onthe display unit 351 by setting the image 11 as the middle channel andsetting the image 12 as the peripheral channel, user information forsetting the image 12 as the middle channel is assumed to be acquired bythe user information acquisition unit 360. For example, when a viewerperforms a manipulation of setting the image 12 as the middle channelusing a pointer such as a remote controller or a gesture, the userinformation for setting the image 12 as the middle channel is acquiredby the user information acquisition unit 360. In this case, asillustrated in FIG. 5b , the images 11 and 12 are displayed on thedisplay unit 351 by setting the image 12 as the middle channel andsetting the image 11 as the peripheral channel. Further, displaypositions of the images 11 and 12 on the display surface of the displayunit 351 are decided based on user information (for example, a manualmanipulation or a line of sight) acquired by the user informationacquisition unit 360.

Communication Example

FIGS. 6 to 8 are sequence charts illustrating a communication processexample between the devices included in the communication system 100according to the first embodiment of the present technology. FIGS. 6 to8 illustrate an example of a communication process between theinformation processing devices 200 and 300.

In FIGS. 6 to 8, the image and audio signal generation unit 250, theimage and audio compression unit 260, and the stream transmission unit270 among the units included in the information processing device 200are illustrated as a data transmission system 201. The antenna 210, thewireless communication unit 220, the control signal reception unit 230,and the control unit 240 are illustrated as a line control system 202.

In FIGS. 6 to 8, the antenna 310, the wireless communication unit 320,the stream reception unit 330, the control unit 370, and the controlsignal transmission unit 380 in the configuration of the informationprocessing device 300 are illustrated as a line control system 301. Theimage and audio decompression unit 340, the image and audio output unit350, and the user information acquisition unit 360 are illustrated as aninput and output system 302.

In FIGS. 6 to 8, first, an example in which an image based on the imagedata from the information processing device 200 is displayed as aperipheral channel on the display unit 351 of the information processingdevice 300 and a low power consumption mode is set in the informationprocessing device 200 is illustrated. Subsequently, an example in whichan image based on the image data from the information processing device200 is displayed as a middle channel on the display unit 351 and anormal power consumption mode is set in the information processingdevice 200 is illustrated. That is, in FIGS. 6 to 8, a connection setupexample of the information processing devices 200 and 300 and atransition example of the power consumption mode in the informationprocessing device 200 are illustrated.

First, when the information processing device 300 is powered up, aprevious output form (which is an output form when the informationprocessing device 300 is powered down) is set as an output form (whichis an image display form and an audio output form) of the informationprocessing device 300 (501). The control unit 370 of the informationprocessing device 300 causes the management information retention unit390 to retain the management information of each source device connectedto the information processing device 300 using the wirelesscommunication (illustrated in FIG. 4). As illustrated in FIG. 5, thecontrol unit 370 of the information processing device 300 causes thedisplay unit 351 to display the images 11 and 12 corresponding to twostreams respectively transmitted from the information processing devices200 and 400 based on the previous output form.

Subsequently, a case in which the user performs a manipulation ofsetting the output form (changing manipulation) is assumed (502). Inthis case, a control signal related to the setting manipulation isacquired as the user information by the user information acquisitionunit 360 and the user information is output to the control unit 370.Then, the control unit 370 changes the content retained in themanagement information retention unit 390 (illustrated in FIG. 4) basedon the user information (503 and 504). For example, as illustrated inFIG. 5b , a case in which the setting manipulation (changingmanipulation) is performed to set the image 11 based on the image datafrom the information processing device 200 as the peripheral channel isassumed. In this case, the control unit 370 changes the display form 396(illustrated in FIG. 4) of the information processing device 200 in themanagement information retention unit 390 to “SUB” (503 and 504).

The information processing device 200 transmits a mode table request (aninquiry request of the resolution, the audio quality, the low powerconsumption mode, and the like) to the information processing device 300periodically or aperiodically (also including only the start time) (505and 506). The mode table request is a request for transmitting eachpiece of information (which is information used to communicate with theinformation processing device 200 with the management informationregarding the information processing device 300 (for example, resolutioninformation or the like which can be displayed by the informationprocessing device 200)) managed in the information processing device300.

When the information processing device 300 receives the mode tablerequest (506), the information processing device 300 transmits commandinformation according to the mode table request (507 and 508). Thecommand information is information regarding the information processingdevice 200 used for the information processing device 300 to give asetting demand to the information processing device 200 along with theradio wave propagation environment and the display form. For example,the command information is information that includes output forminformation (for example, a middle channel and a peripheral channel) ofthe resolution and the audio quality, whether to correspond to the lowpower consumption mode, a maker name, and presence or absence of amulti-reception diversity function. For example, the command informationis information that includes the resolution and the audio quality, thekinds of image and audio codecs, presence of absence of a 3D function,presence or absence of the content protection, the display size of adisplay device, topology information, a usable protocol, settinginformation (port information or the like) of the protocol, connectioninterface information (the type of connector or the like), horizontalsynchronization and vertical synchronization positions, performancepriority request information of a source device, a mode control tableresponse to whether to correspond to the low power consumption mode, amaximum transmission throughput or a receivable maximum throughput ofwireless transmission, central processing unit (CPU) power, a batteryremaining quantity, and power supply information. Each piece ofinformation is included in a part of capability information. Here, theoutput form information of the resolution and the audio qualityregarding the information processing device 200 is, for example,information indicating whether the display form of the data from theinformation processing device 200 is a main form (a middle channel) or asub-form (a peripheral channel). The information processing device 300transmits the command information including a demand for the setting ofthe resolution and the audio quality or the low power consumption modeas a parameter from the viewpoint of the information processing device300. Besides each piece of information regarding the informationprocessing device 200, the information processing device 300 maytransmit each piece of information regarding all the source devices asthe command information. In this case, the information processing device200 selects and uses only information dedicated for the own informationprocessing device. When a device that conforms to Wi-Fi CertifiedMiracast, the device corresponds to wfd-audio-codecs, wfd-video-formats,wfd-content-protection, wfd-displayedid, wfd-coupledsink,wfd-client-rtpports, wfd-I2C, wfd-uibccapability, wfd-connectortype,wfd-sandby-resume-capability, and the like defined as RTSP Message, butmessage content to be transmitted is assumed not to be limited in thesecommands.

When the information processing device 200 receives the commandinformation (508), the control unit 240 of the information processingdevice 200 specifies whether the output form of the data from theinformation processing device 200 is the main form or the sub-form basedon the command information. Based on the command information, thecontrol unit 240 of the information processing device 200 determineswhether the information processing device 300 has a functioncorresponding to a power consumption operation mode. Subsequently, thecontrol unit 240 of the information processing device 200 transmits modesetting information indicating that the specified output form is set tothe information processing device 300 (509 and 510). Here, the sub-formis assumed to be specified as the output form of the data from theinformation processing device 200. The information processing device 300is assumed to have a function corresponding to the low power consumptionmode. Accordingly, the control unit 240 of the information processingdevice 200 transmits mode setting information for notifying theinformation processing device 300 that the specified output form(sub-form) is set and the low power consumption mode is set, to theinformation processing device 300 (509 and 510).

In this example, the example in which the image is specified as themiddle channel or the peripheral channel and the low power consumptionmode is set based on the command information has been described, but thelow power consumption mode may be set without using the determination ofthe middle channel or the peripheral channel as a reference. Forexample, the low power consumption mode may be set by interchanging apermission flag indicating that the mode can transition to the low powerconsumption mode between the source and sink devices.

Subsequently, the control unit 240 of the information processing device200 sets a image transmission mode (the peripheral channel) as thetransmission mode (511). Accordingly, in the data transmission system201, audio quality is set to output a resolution and sub-audio fordisplaying the peripheral channel (512). In the line control system 202,the low power consumption mode is set (513).

Here, when the low power consumption mode is set in this way, both ofthe sink and source devices are assumed to have the function. Forexample, a mobile device (for example, a cellular phone, a smartphone,or a tablet terminal) is driven by a battery to operate in many cases.Therefore, when the output form of the data from the own informationprocessing device is not the main form (when the output form is thesub-form), it is desirable to reduce battery consumption of the owninformation processing device as much as possible. Accordingly, in thesource device in which the output form in the sink device is set to thesub-form, it is desirable to set the low power consumption mode.Further, in the setting process (512), only an audio of the sourcedevice allocated to the middle channel may be set to be reproduced froma speaker and the audio of the source device allocated to the peripheralchannel may be set not to be reproduced. The volume of the audio of thesource device allocated to the middle channel may be set as a main andthe volume of the audio of the source device allocated to the peripheralchannel may be set to be lowered and reproduced.

In this way, the control unit 370 of the information processing device300 performs control such that the low power consumption mode in theinformation processing device 200 is set when the output form is set asthe peripheral channel (sub-display). That is, the control unit 370 ofthe information processing device 300 performs control such that thepower consumption mode is set in the information processing device 200based on the output form of the display unit 351 in which the imageinformation is output based on the stream.

When the low power consumption mode is set in this way (513), thecontrol unit 240 of the information processing device 200 startsintermittent transmission (514 to 522).

Specifically, the information processing device 200 stops thetransmission process only for a given time and sleeps each unit (514).Subsequently, when the given time passes (514), the informationprocessing device 200 wakes up each unit of the information processingdevice 200 to perform the transmission process and performs thetransmission process to the information processing device 300 (515 to520).

For example, the control unit 240 of the information processing device200 transmits an inquiry message for confirming whether any change ismade in the information processing device 300 to the informationprocessing device 300 (for example, a change in the output form) (515and 516).

When the inquiry message is received (516), the control unit 370 of theinformation processing device 300 transmits a response message to theinformation processing device 200 to notify whether any change is made(for example, the change in the output form) (517 and 518). Here, it isassumed that no change is made in the information processing device 300(for example, the change in the output form). Therefore, the controlunit 370 of the information processing device 300 transmits a responsemessage for notifying that no change is made (for example, the change inthe output form) to the information processing device 200 (517 and 518).

When the response message indicating that no change is made (forexample, the change in the output form) in this way (518), it is notnecessary to change the setting in the information processing device200. Therefore, the control unit 240 of the information processingdevice 200 transmits a stream for outputting the peripheral channel andthe sub-audio to the information processing device 300 (519 and 520).When the information processing device 300 receives the stream in thisway (520), the information processing device 300 outputs the image andthe audio based on the received stream (521). For example, asillustrated in FIG. 5b , the image 11 based on the stream from theinformation processing device 200 is displayed as the peripheral channelon the display unit 351.

When the transmission process ends (519), the information processingdevice 200 stops the transmission process only for a given time andsleeps each unit (522). The intermittent transmission is continuouslyperformed until a change request is given from the informationprocessing device 300.

Here, in the intermittent transmission, a period in which the stream isnot transmitted from the information processing device 200 occurs.Therefore, the information processing device 300 preferably performs adisplay process of interpolating and displaying the image correspondingto the stream finally received from the information processing device200. However, the information processing device 300 is assumed not tohave an interpolation process function either. In this case, during thesleep period, the image from the information processing device 200 maynot be displayed on the display unit 351. Therefore, when theinformation processing device 300 does not have the interpolationprocess function, the image data from the information processing device200 may be continuously transmitted. For example, in the stream which isa transmission target from the information processing device 200, thefinal image data at the time of the transmission stop is retained in atransmission buffer. During the sleep period, the image processing ofthe information processing device 200 is stopped, but the transmissionprocess is continuously performed in a wireless link and the image dataretained in the transmission buffer is continuously transmitted.

During the sleep period, only the image corresponding to the streamtransmitted from the information processing device 400 may be displayedon the display unit 351. For example, the image corresponding to thestream transmitted from the information processing device 400 can bedisplayed on the entire surface of the display unit 351.

Next, an example of the case in which the user performs a manipulationof setting the output form (changing manipulation) will be described.

When the user performs the manipulation of setting the output form(changing manipulation) (531), as described above, the control unit 370changes the content retained in the management information retentionunit 390 (illustrated in FIG. 4) based on the user information relatedto the setting manipulation (532 and 533). For example, as illustratedin FIG. 5a , the case in which the user performs the settingmanipulation (changing manipulation) of setting the image 11 based onthe image data from the information processing device 200 as the middlechannel is assumed. In this case, the control unit 370 changes thedisplay form 396 (illustrated in FIG. 4) of the information processingdevice 200 in the management information retention unit 390 to “MAIN”(532 and 533).

Here, as described above, when the low power consumption mode is set inthe information processing device 200, the information processing device200 is assumed to sleep. In this way, when the information processingdevice 200 sleeps, the information processing device 200 may not benotified that the user performs the manipulation of setting the outputform (changing manipulation).

Accordingly, when the user performs the manipulation of setting theoutput form (changing manipulation) 531 and the content retained in themanagement information retention unit 390 (illustrated in FIG. 4) ischanged (532 and 533), the control unit 370 of the informationprocessing device 300 sets a change trigger (534). The change trigger isa trigger for notifying the information processing device 200 that theuser performs the manipulation of setting the output form (changingmanipulation) when the inquiry message is received from the informationprocessing device 200. Through the change trigger, the informationprocessing device 200 cancels the state of the standby mode and notifiesthe information processing device 200 that the user performs themanipulation of setting the output form (changing manipulation).

Here, a case in which each unit of the information processing device 200wakes up and the transmission process to the information processingdevice 300 starts is assumed. In this case, the control unit 370 of theinformation processing device 300 transmits a standby cancellationmessage to the information processing device 200 (535 and 536).

When the standby cancellation message is received (536), the controlunit 240 of the information processing device 200 transmits a responsemessage to the information processing device 300 (537 and 538).

In this way, it is necessary to inquire the setting in the informationprocessing device 200 in accordance with the standby mode cancellationrequest from the sink device (535 to 538). Therefore, the control unit240 of the information processing device 200 transmits the mode tablerequest to the information processing device 300 (539 and 540). Asdescribed above, the mode table request is a request for transmittingeach piece of information (the management information regarding theinformation processing device 200) managed in the information processingdevice 300. In the above-described processes (535 to 538), the messages(for example, the response message to the inquire message in theprocesses (515 to 518)) of the change (for example, the change in theoutput form) may be interchanged.

When the information processing device 300 receives the mode tablerequest (540), the information processing device 300 transmits thecommand information according to the mode table request (541 and 542).Here, when the command information is already transmitted from theinformation processing device 300 to the information processing device200, the information processing device 200 already acquire theinformation included in the command information. Therefore, theinformation processing device 300 may transmit only differenceinformation as the command information according to the mode tablerequest (541 and 542). The difference information is informationregarding the change and is, for example, output form information of theresolution and the audio quality regarding the information processingdevice 200.

When the command information is received (542), the control unit 240 ofthe information processing device 200 specifies whether the output formof the data from the information processing device 200 is the main formor the sub-form based on the command information. Subsequently, thecontrol unit 240 of the information processing device 200 transmits themode setting information indicating the setting of the specified outputform to the information processing device 300 (543 and 544). Here, themain form is assumed to be specified as the output form of the data fromthe information processing device 200. Accordingly, the control unit 240of the information processing device 200 transmits the mode settinginformation for notifying the information processing device 300 that thespecified output form (main form) is set and the normal powerconsumption mode is set, to the information processing device 300 (543and 544). The processes (539 to 544) may be performed with CapabilityRe-negotiation when the device conforms to Wi-Fi Certified Miracast. Inthe case of Capability Re-negotiation, it is not necessary to performnegotiation again in regard to the setting values unchanged in theoutput form in the process (534). For example, wfd-displayedid,wfd-client-rtpports, wfd-I2C, and wfd-connectortype can be exemplified.

Subsequently, the control unit 240 of the information processing device200 sets the image transmission mode (the middle channle) as thetransmission mode (545). Accordingly, in the data transmission system201, the resolution for displaying the middle channel and the audioquality for outputting the main audio are set (546). In the line controlsystem 202, the normal power consumption mode is set (547).

When the normal power consumption mode is set in this way (547), thecontrol unit 240 of the information processing device 200 starts anormal transmission process (548 and 549). That is, the informationprocessing device 200 transmits the stream for outputting the middlechannel and the main audio to the information processing device 300 (548and 549). When the stream is received in this way (549), the informationprocessing device 300 outputs the image and the audio based on thereceived stream (550). For example, as illustrated in FIG. 5a , theimage 11 based on the stream from the information processing device 200is displayed as the middle channel on the display unit 351.

In this example, the example in which the previous output form (theoutput form when the information processing device 300 is powered down)is set as the display form of the display unit 351 when the informationprocessing device 300 is powered up has been described. However, whenthe information processing device 300 is powered up, another output formmay be set. For example, when the information processing device 300 ispowered up, a default output form may be normally set. Alternatively,the output form may be decided based on an order of connection to theinformation processing device 300.

In FIGS. 6 to 8, the example in which the information processing device200 inquires the setting information regarding the informationprocessing device 300 and sets the transmission parameters based on thereceived parameter information has been described. However, theinformation processing device 200 may ask a setting request for theparameters desired to be set to the information processing device 300and may set the parameters when the information processing device 200receives a response indicating that there is no problem from theinformation processing device 300. This example is illustrated in FIGS.9 and 10.

Communication Example

FIGS. 9 to 11 are sequence charts illustrating a communication processexample between devices included in the communication system 100according to the first embodiment of the present technology. In FIGS. 9and 10, a part of the communication process example illustrated in FIGS.6 to 8 is modified. Therefore, in FIGS. 9 and 10, the same referencenumerals are given to common portions to the communication processexample illustrated in FIGS. 6 to 8 and the description thereof will bepartially omitted. In FIG. 11, a part of the communication processexample illustrated in FIG. 9 is modified. Therefore, in FIG. 11, thesame reference numerals are given to common portions to thecommunication process example illustrated in FIG. 9 and the descriptionthereof will be partially omitted.

Processes (561 to 564) illustrated in FIG. 9 correspond to the processes(501 to 504) illustrated in FIG. 6.

Subsequently, the control unit 370 of the information processing device300 transmits a mode status notification for notifying the informationprocessing device 200 of the output form set by the user to theinformation processing device 200 (565 and 566). The mode statusnotification is information for giving notification of the resolutionand the audio quality, the kinds of image and audio codecs, presence ofabsence of a 3D function, presence or absence of the content protection,the display size of a display device, topology information, a usableprotocol, setting information (port information or the like) of theprotocol, connection interface information (the type of connector or thelike), horizontal synchronization and vertical synchronizationpositions, performance priority request information of a source device,a mode control table response to whether to correspond to the low powerconsumption mode, a maximum transmission throughput or a receivablemaximum throughput of wireless transmission, central processing unit(CPU) power, a battery remaining quantity, and power supply informationwhich can be set by the information processing device 200 along with theoutput form (for example, the main form or the sub-form) set by theuser.

In this way, immediately after the setting manipulation of the outputform by the user in the information processing device 300 is performed,the mode status notification for notifying the information processingdevice 200 of the output form related to the setting manipulation can betransmitted to the information processing device 200. Therefore, it ispossible to shorten a setting time (change time) between the informationprocessing devices 200 and 300 connected using the wirelesscommunication.

When the mode status notification is received (566), the control unit240 of the information processing device 200 compares a status parameterspecified by the received mode status notification to a status parameterof the own information processing device. Subsequently, the control unit240 of the information processing device 200 decides the setting content(for example, the resolution and audio, and the power consumption mode)based on a comparison result. Subsequently, the control unit 240 of theinformation processing device 200 transmits a mode setting request fornotifying of the decided setting content (for example, the resolutionand audio, and the power consumption mode) to the information processingdevice 300 (567 and 568).

When the mode setting request is received (568), the control unit 370 ofthe information processing device 300 determines whether to permit thesetting content (for example, the resolution and audio, and the powerconsumption mode) specified by the received mode setting request. Then,the control unit 370 of the information processing device 300 transmitsa mode setting availability command for notifying the determinationresult to the information processing device 200 (569 and 570).

When the mode setting availability command is received (570), thecontrol unit 240 of the information processing device 200 confirms thecontent of the mode setting availability. For example, when a modesetting availability command indicating permission of the settingcontent related to the mode setting request transmitted by theinformation processing device 200 is received, the control unit 240 ofthe information processing device 200 sets the image transmission mode(the peripheral channel) as the transmission mode (571). Further,processes (571 to 574) illustrated in FIG. 9 correspond to the processes(511 to 514) illustrated in FIG. 6. Further, processes (575 to 578)illustrated in FIG. 10 correspond to the processes (519 to 522)illustrated in FIG. 7.

When a mode setting availability command indicating non-permission ofthe setting content related to the mode setting request transmitted bythe information processing device 200 is received, the control unit 240of the information processing device 200 newly decides the settingcontent (for example, the resolution and audio, and the powerconsumption mode). Then, the control unit 240 of the informationprocessing device 200 transmits a mode setting request for notifying theinformation processing device 300 of the newly decided setting content(for example, the resolution and audio, and the power consumption mode)to the information processing device 300.

Processes (581 to 583) illustrated in FIG. 10 correspond to theprocesses (531 to 533) illustrated in FIG. 7.

Subsequently, the control unit 370 of the information processing device300 transmits a mode status change notification for notifying theinformation processing device 200 of the output form changed by the userto the information processing device 200 (584 and 585). The mode statuschange notification is information for notifying of the resolution andthe audio quality which can be set by the information processing device200 and whether to correspond to the low power consumption mode alongwith the output form (for example, the main form or the sub-form)changed by the user.

When the mode status change notification is received (585), the controlunit 240 of the information processing device 200 decides the settingcontent (for example, the resolution and audio, and the powerconsumption mode). The process of deciding the setting content is thesame as the above-described decision process. Subsequently, the controlunit 240 of the information processing device 200 transmits the modechange request for notifying the information processing device 300 ofthe decided setting content (for example, the resolution and audio, andthe power consumption mode) to the information processing device 300(586 and 587).

When the mode change request is received (587), the control unit 370 ofthe information processing device 300 determines whether to permit thesetting content (for example, the resolution and audio, and the powerconsumption mode) specified by the received mode change request. Then,the control unit 370 of the information processing device 300 transmitsthe mode setting availability command for notifying the determinationresult to the information processing device 200 (588 and 589).

When the mode setting availability command is received (589), thecontrol unit 240 of the information processing device 200 confirms thecontent of the mode setting availability command and sets thetransmission mode (590). This confirmation process is the same as theabove-described confirmation process. Processes (590 to 595) illustratedin FIG. 10 correspond to the processes (545 to 550) illustrated in FIG.8.

Here, when the source device performs switch between the peripheralchannel and the middle channel, information (for example, informationfor comprehending the beginning of a group of picture (GOP) orinformation for comprehending the beginning of a picture) indicating atiming of the switch may be included in the stream to be transmitted. Inother words, when the source device performs the switch between the maindisplay and the sub-display, information indicating the timing of theswitch may be transmitted to the sink device. In this case, the sinkdevice receiving the stream can switch between the peripheral channeland the middle channel at an appropriate timing based on informationindicating the timing.

Here, FIGS. 6 to 10 illustrates the example in which the standby andwake-up of the source device connected to the sink device is controlled.Here, the standby and wake-up of the sink device may be controlled basedon the standby and wake-up of the source device connected to the sinkdevice. For example, when all of the source devices connected to thesink device stand by, control can be performed such that the sink devicestands by. When at least one of the source devices connected to the sinkdevice wakes up, control can be performed such that the sink devicewakes up.

A modification example of the case in which the sink device notifies thesource device that the content retained in the process (564) is changedin the processes (565 to 570) illustrated in FIG. 9 and the sourcedevice transmits the mode table request is illustrated in FIG. 11.

As illustrated in FIG. 11, the information processing device 300transmits a mode status notification to notify the informationprocessing device 200 that the output form is changed (564) and promptto transmit a mode setting request from the information processingdevice 200 (565 and 566). When the correspondence is possible, theinformation processing device 200 receiving the mode status notificationtransmits a mode status notification approval indicating approval of themode status notification to the information processing device 300 (851and 852).

In this way, after the mode status notification approval is transmitted(851), processes are performed (853 to 858). The processes (853 to 858)correspond to the processes (505 to 510) illustrated in FIG. 6. In thisway, by performing the processes (853 to 858) after the transmission ofthe mode status notification approval (851), the stream transmissioncontrol (for example, the data transmission speed control and thescalability transmission rate control) can be appropriately in a statechange (the change of the output form (564)).

Here, for example, in a command prepared in Wi-Fi Certified Miracast, anRTSPM5 message including wfd-triggered-method is currently defined as acommand which is transmitted to the information processing device 300 bythe information processing device 200. However, when the RTSPM5 messageincluding wfd-triggered-method is expanded as a command which istransmitted to the information processing device 200 by the informationprocessing device 300, the RTSPM5 message including wfd-triggered-methodcan be received by the information processing device 200 and theinformation processing device 200 can start capability re-negotiationwith the information processing device 300. That is, the managementinformation can be exchanged using the RTSPM5 message includingwfd-triggered-method. For example, when the management information ischanged, the control unit 370 of the information processing device 300can perform control such that the RTSPM5 message includingwfd-triggered-method defined in the Wi-Fi Certified Miracastspecification is transmitted as a command for notifying the informationprocessing device 200 of the change to the information processing device200. Beside the command, a command may be newly defined to serve as anequivalent.

Operation Example of Information Processing Device (Source Device)

FIG. 12 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 200 according to the first embodiment of the present technology.FIG. 12 illustrates an example of a case in which the informationprocessing device 200 first transmits the stream (the image data and theaudio data) with a standard resolution to the information processingdevice 300. In this case, the output based on the stream to theinformation processing device 300 is assumed to be performed.

First, the control unit 240 transmits the mode table request to theinformation processing device 300 (step S901). Subsequently, the controlunit 240 determines whether the command information is received from theinformation processing device 300 (step S902). When the commandinformation is not received, the monitoring is continuously performed.When the command information may not be received despite waiting of agiven time, the process may end as a timeout. For example, in Wi-FiCertified Miracast, a timeout from 5 seconds to 9 seconds is setaccording to a situation.

When the command information is received from the information processingdevice 300 (step S902), the control unit 240 transmits the mode settinginformation indicating that the mode is set based on the receivedcommand information to the information processing device 300 (stepS903).

Subsequently, the control unit 240 sets the mode based on the receivedcommand information (step S904). When a change request for increasingthe resolution is included in the command information, the control unit240 sets the resolution of the image and the audio in response to thechange request. When a change request for decreasing the resolution isincluded in the command information, the control unit 240 sets theresolution of the image and the audio quality of the audio in responseto the change request.

Subsequently, the control unit 240 performs the transmission process oftransmitting the stream to the information processing device 300according to the setting (step S905).

Subsequently, the control unit 240 determines whether the low powerconsumption mode is set (step S906). When the low power consumption modeis not set (that is, the normal power consumption mode is set), theprocess proceeds to step S911. Conversely, when the low powerconsumption mode is set (step S906), the control unit 240 sleeps for agiven time (step S907).

Subsequently, the control unit 240 transmits an inquiry message to theinformation processing device 300 (step S908). Subsequently, the controlunit 240 determines whether a response message is received from theinformation processing device 300 (step S909). When the response messageis not received, the monitoring is continuously performed. When theresponse message may not be received despite of waiting of a given time,the process may end as a timeout. For example, in Wi-Fi CertifiedMiracast, a timeout from 5 seconds to 9 seconds is set according to asituation.

When the response message is received from the information processingdevice 300 (step S909), the control unit 240 determines whether a changerequest is included in the response message (step S910). When the changerequest is included in the response message (step S910), the processreturns to step S901.

When the change request is not included in the response message (stepS910), the control unit 240 determines whether the change request isreceived (step S911). When the change request is received (step S911),the process returns to step S901. Conversely, when the change request isnot received (step S911), the control unit 240 determines whether atransmission stop manipulation is performed (step S912). When thetransmission stop manipulation is performed (step S912), the operationof the data transmission process ends. Conversely, when the transmissionstop manipulation is not performed (step S912), the process returns tostep S905.

Operation Example of Information Processing Device (Sink Device)

FIG. 13 is a flowchart illustrating an example of a processing procedureof a data transmission speed control process performed by theinformation processing device 300 according to the first embodiment ofthe present technology. FIG. 13 illustrates an example in which settingcontent (for example, a resolution and a power consumption mode) relatedto the source device is decided when the information processing device300 receives the stream (the image data and the audio data).

For example, the control unit 370 of the information processing device300 can decide the resolution to be used and the frequency channel to beused according to the user information for setting the middle channel ora link radio wave propagation environment between the informationprocessing device 300 and each source device.

For example, a case in which a user manipulation of selecting the image12 in the state illustrated in FIG. 5a performed is assumed. In thiscase, it is desirable to increase the resolution of the image 12 anddecreases the resolution of the image 11. Further, it is desirable toselect optimum resolutions of the images 11 and 12 according to elapseof a time and based on the link radio wave propagation environment ofeach source device.

For example, the information processing device 300 can comprehend theradio wave propagation characteristics while flowing data correspondingto the corresponding throughput to the plurality of frequency channels.For example, the information processing device 300 retains a table tocomprehend an ideal throughput for each of the plurality of frequencychannels. Then, the information processing device 300 may comprehend anavailable data transmission speed of the frequency channel to be usedbased on the number of simultaneously used source devices and the PERand may select an optimum frequency channel for each frequency channel.

For example, the control unit 370 acquires the management informationfrom the management information retention unit 390 and acquires the userinformation from the user information acquisition unit 360 (step S921).Subsequently, the control unit 370 decides the output form based on theacquired management information and user information (step S922). Basedon the decided output form, the images corresponding to two streamstransmitted from each of the plurality of source devices are displayedon the display unit 351.

Subsequently, the control unit 370 determines whether there is thesource device for which the PER included in the management informationis less than a threshold value (step S923). When there is the sourcedevice for which the PER included in the management information is equalto or less than the threshold value (step S923), the control unit 370decides a change request for increasing the resolution of the sourcedevice (step S924). The control unit 370 performs control such that ahigh data transmission speed is allocated to the middle channel inaccordance with the output form based on the user information. Forexample, the change request is included in the command information (forexample, the command information illustrated in FIG. 6) to betransmitted to this source device. It may be determined whether thethroughput after the increase in the resolution of the source device isless than the threshold value and the rate of the stream may becontrolled based on the determination result.

When there is no source device for which the PER included in themanagement information is equal to or less than the threshold value(step S923), the control unit 370 determines whether the throughput ofeach source device is equal to or less than a threshold value based onthe management information (step S925). That is, it is determinedwhether the throughput of each link is not problematic even for thecurrent frequency channel (step S925).

When the throughput of each source device is not equal to or less thanthe threshold value (step S925), the process returns to S921.Conversely, when the throughput of each source device is equal to orless than the threshold value (step S925), the control unit 370determines whether there is the source device corresponding to the lowpower consumption mode based on the management information (step S926).

When there is the source device corresponding to the low powerconsumption mode (step S926), the control unit 370 decides a changerequest for setting the low power consumption mode in the source devicecorresponding to the low power consumption mode (step S928). Forexample, the change request is included in the command information (forexample, the command information illustrated in FIG. 6) to betransmitted to this source device.

When there is no source device corresponding to the low powerconsumption mode (step S926), the control unit 370 decides a changerequest for decreasing the resolution of the source device (the sourcedevice for which the PER is equal to or less than the threshold value)(step S927). For example, the change request is included in the commandinformation (for example, the command information illustrated in FIG. 6)to be transmitted to this source device.

It is determined whether a reception stop manipulation is performed(step S929). When the reception stop manipulation is performed, theoperation of the data transmission speed control process ends. When thereception stop manipulation is not performed, the process returns tostep S921. When there is the source device that enters the sleep statethrough the setting of the low power consumption mode, the number ofsource devices connected to the information processing device 300decreases. In this case, the threshold value for the throughput in stepS925 may be changed. After the threshold value for the throughput ischanged in this way, a step corresponding to step S925 may be furtherperformed.

In this way, it is possible to realize a control protocol in which thesink device trains a line environment for a given time and notifies thesource device of the resolution with which stable video communicationcan be performed. A control protocol in which the source device performstraining in a line environment for a given time and requests aresolution with which stable video communication can be performed, andthe sink device responds to the request may also be realized.

In this way, the control unit 370 of the information processing device300 can perform transmission control (for example, the data transmissionspeed control and the scalability transmission rate control) of twostreams transmitted from each source device based on the managementinformation of the management information retention unit 390 and theuser information acquired by the user information acquisition unit 360.

Further, control may be performed such that a sum data transmissionspeed of the two streams transmitted from each of the informationprocessing devices 200 and 400 is minimized. For example, a maximumallowable value of the sum data transmission speed is set in the controlunit 370 of the reception side information processing device 300. Afterthe control unit 370 transmits a change request for decreasing a bitrate to the information processing device 200, the control unit 370acquires bit rates of two streams transmitted from the informationprocessing devices 200 and 400 from the stream reception unit 330.Subsequently, the control unit 370 calculates a sum data transmissionspeed of the acquired two streams. Subsequently, the control unit 370decides the bit rate of the streams transmitted from the informationprocessing device 400 within a range not greater than the set maximumallowable value and transmits a change request for increasing the bitrate to the information processing device 400. When the PER is large andthus is not receivable in the same frequency channel despite of thesetting of the minimum bit rate, a different frequency channel may beused. When the images (the middle channel and the peripheral channel)are paused for a given time or more, the image data may be stopped aslong as a manipulation (for example, pointing) is not performed by theuser.

In this way, according to the first embodiment of the presenttechnology, even when one sink device receives a plurality of streamstransmitted from a plurality of source devices, appropriate streamtransmission control (for example, the data transmission speed control)can be performed according to a manipulation, a situation, and anintention of the user. For example, it is possible to decrease the datatransmission speeds of some of the plurality of image and audio streamsand increase the data transmission speeds of the remaining streamsaccording to an operation, a situation, and an intention of the user.

For example, when a sink device receives and displays a plurality ofstreams, important images and audios with high quality set timely by theuser can be enjoyed. For the otherwise images and audios, the datatransmission speeds can be adjusted automatically to the optimumfrequency channel, power consumption, and transmission rate.

Here, for the management information retained in the managementinformation retention unit 390, a command prepared in Wi-Fi CertifiedMiracast can be used for exchanging the management information. In thiscase, capability negotiation or capability re-negotiation defined in theWi-Fi Display specification can be used. Here, as capability negotiationor capability re-negotiation, for example, RFC5939 or the Wi-FiCertified Miracast specification can be exemplified. However, capabilitynegotiation or capability re-negotiation is not limited thereto, but isdefined as interchange of the device performance information. Acommunication example of the interchange using a command of the Wi-FiCertified Miracast specification is illustrated in FIGS. 14 to 16.

Communication Example of Interchange Using Wi-Fi Certified MiracastSpecification Command

FIGS. 14 to 16 are sequence charts illustrating a communication processexample between a source device and a sink device according to the firstembodiment of the present technology. FIGS. 14 to 16 illustrate acommunication example of interchange using an RTSP protocol. A sourcedevice 820 corresponds to the information processing devices 200 and 400and a sink device 830 corresponds to the information processing device300.

First, the description will be made with reference to FIG. 14. Forexample, as indicated by a dotted rectangle 840 of FIG. 14, an “RTSP M3Request” (RTSP GET_PARAMETER Request) message transmitted from thesource device to the sink device and an “RTSP M3 Response” (RTSPGET_PARAMETER Response) message transmitted from the sink device to thesource device in response to the “RTSP M3 Request” (RTSP GET_PARAMETERRequest) message can be used. This exchange process corresponds to, forexample, the processes (505 to 508) illustrated in FIG. 6 and theprocesses (539 to 542) illustrated in FIG. 8. On the other hand, themessages may be appropriately transmitted from the source device to thesink device. For example, the interchange of the “RTSP M3 Request” (RTSPGET_PARAMETER Request) message and the “RTSP M3 Response” (RTSPGET_PARAMETER Response) message may be omitted, the managementinformation may be included in a message to be transmitted from thesource device to the sink device, the management information may betransmitted from the source device to the sink device, and the sinkdevice may select the information and retain the information in themanagement information retention unit 390. For example, when the contentprotection setting is performed, link protection setup is performedafter M3 Response. Therefore, it is desirable to perform communicationwhile ensuring a secrecy ability of a link set once by transmitting onlymessages of M4 or higher.

The interchange of information regarding the power consumption mode canbe performed with predetermined messages using the RTSP protocol. Forexample, three kinds of management information of the following (1) to(3) can be exchanged:

(1) “setting to the standby mode,”

(2) “when the source device cancels the standby mode or when the sourcedevice cancels the standby mode of the sink device,” and

(3) “when the sink device cancel the standby mode or when the sinkdevice cancels the standby mode of the source device.”

First, the description will be made with reference to FIG. 15. Forexample, when a command prepared in Wi-Fi Certified Miracast is used, an“RTSP M12 Request” (RTSP SET_PARAMETER (with WFD-standby)) messagetransmitted from the source device 820 to the sink device 830 and an“RTSP M12 Response” (RTSP OK) message transmitted from the sink device830 to the source device 820 in response to the “RTSP M12 Request” (RTSPSET_PARAMETER (with WFD-standby)) message can be used in the interchangeof (1) “setting to the standby mode,” as described above. On the otherhand, the same also applies to the setting to the standby mode from thesink device 830 to the source device 820.

Next, the description will be made with reference to FIG. 16. Forexample, (2) “when the source device cancels the standby mode or whenthe source device cancels the standby mode of the sink device,” asdescribed above, the source device 820 interchanges an “RTSP M5 Request”(RTSP SET_PARAMETER (Request (wfd-trigger-method: PLAY)) messagetransmitted to the sink device 830 and an “RTSP M5 Response” (RTSP OK)message transmitted from the sink device 830 to the source device 820 inresponse to the “RTSP M5 Request” (RTSP SET_PARAMETER (Request(wfd-trigger-method: PLAY)) message. The sink device 830 can uses an“RTSP M7 Request” (RTSP PLAY Request) message transmitted to the sourcedevice 820 and an “RTSP M7 Response” (RTSP OK) message transmitted fromthe source device 820 to the sink device 830 in response to the “RTSP M7Request” (RTSP PLAY Request) message.

For example, (3) “when the sink device cancel the standby mode or whenthe sink device cancels the standby mode of the source device,” asdescribed above, the sink device 830 can use the “RTSP M7 Request” (RTSPPLAY Request) message transmitted to the source device 820 and the “RTSPM7 Response” (RTSP OK) message transmitted from the source device 820 tothe sink device 830 in response to the “RTSP M7 Request” (RTSP PLAYRequest) message. The interchange corresponds to, for example, theprocesses (515 to 518) illustrated in FIG. 7 and the processes (535 to538) illustrated in FIG. 7.

For example, in the interchange of the processes (565 to 570)illustrated in FIG. 9, the “RTSP M12 Request” (RTSP SET_PARAMETER (withWFD-standby)) message transmitted from the sink device 830 to the sourcedevice 820 and the “RTSP M12 Response” (RTSP OK) message transmittedfrom the source device 820 to the sink device 830 in response to the“RTSP M12 Request” (RTSP SET_PARAMETER (with WFD-standby)) message canbe used.

Further, for example, in the interchange of the processes (584 to 589)illustrated in FIG. 10, the “RTSP M7 Request” (RTSP PLAY Request)message transmitted from the sink device 830 to the source device 820and the “RTSP M7 Response” (RTSP OK) message transmitted from the sourcedevice 820 to the sink device 830 in response to the “RTSP M7 Request”(RTSP PLAY Request) message may be used.

In this way, the wireless communication unit 320 can perform theexchange of the capability information with capability negotiation orcapability re-negotiation defined in the Wi-Fi Display specification.For example, the capability information is exchanged with the RTSP M3message in capability negotiation or capability re-negotiation.

In this way, for example, the wireless communication unit 320 of theinformation processing device 300 performs the communication with thesource device to exchange the capability information regarding theinformation processing device 300 and the capability informationregarding the information processing device 200. The wirelesscommunication unit 220 of the information processing device 200 performsthe communication with the information processing device 300 to exchangethe capability information regarding the information processing device200 and the capability information regarding the information processingdevice 300. In this case, the wireless communication units 220 and 320can exchange the capability information with capability negotiation orcapability re-negotiation.

The control unit 370 of the information processing device 300 performsthe stream transmission control (for example, the data transmissionspeed control and the scalability transmission rate control) with theinformation processing device 200 based on the capability informationregarding the information processing device 200, the radio wavepropagation measurement information regarding the communication with theinformation processing device 200, and the use of the informationprocessing device 300. A stream transmission method is different from inthe embodiment of the present technology, but the control unit 240 ofthe information processing device 200 can also perform the streamtransmission control (for example, the data transmission speed controland the scalability transmission rate control) with the informationprocessing device 300 based on the control performed from theinformation processing device 300 based on the capability informationregarding the information processing device 200 and the radio wavepropagation measurement information regarding the communication of thestream with the information processing device 300.

The control unit 370 of the information processing device 300 performsthe control such that the power consumption mode is set in theinformation processing device 200 based on the capability information(for example, the information indicating whether the device is a mobiledevice) regarding the information processing device 200. In this case,the control unit 370 can perform the control such that the low powerconsumption mode is set in the information processing device 200 basedon the capability information regarding the information processingdevice 200 and the management information for managing the informationprocessing device 200. The control unit 240 of the informationprocessing device 200 sets the power consumption mode based on thecontrol performed from the information processing device 300 based onthe capability information regarding the information processing device200. In the embodiment of the present technology, the example of thetopology in which two source devices are used has been described, but anembodiment of the present technology is not limited to the embodiment ofthe present technology. For example, when the number of devices is 2 ormore, it is necessary to control data transmission speed controlcorresponding to the number of devices and state transition isconsiderable. Therefore, the control is difficult, but benefit can beobtained. It is possible to also correspond to topology in which two ormore source devices are connected.

2. Second Embodiment

In a second embodiment of the present technology, an example ofswitching a connection between the source device and the sink device viaan access point and a direct connection between the source device andthe sink device will be described.

Configuration Example of Communication System

FIG. 17 is a diagram illustrating a system configuration example of acommunication system 700 according to the second embodiment of thepresent technology.

The communication system 700 includes an access point 701, a network702, information processing devices 703, 704, 710, 720, and 730, adisplay device 731, and a control device 740.

The access point 701 is an access point of a wireless LAN (for example,Wi-Fi). For example, the access point 701 has a function of aninfrastructure mode of an IEEE802.11 standard. The access point 701 isconnected to one or more information processing devices (for example, atransmission side information processing device (source device) and areception side information processing device (sink device)).

The access point 701 can be connected with the information processingdevice 730 via a wired line (for example, Ethernet (registeredtrademark)). For example, the access point 701 can be connected with theinformation processing device 730 via the network 702. The access point701 may be connected with an internal bus of the information processingdevice 730 and perform a process. Examples of the internal bus of theinformation processing device 730 include a Universal Serial Bus (USB),Peripheral Component Interconnect (PCI), and PCI Express. The connectionbetween the access point 701 and the information processing device 730may be a wired connection or a wireless connection (for example, thewireless LAN). For example, in the case of the wireless LAN, the network702 is connected to the information processing device 730, and theinformation processing device 730 has to determine whether atransmission/reception process is a transmission/reception process withthe access point 701 or a transmission/reception process with theinformation processing device 710.

In the second embodiment of the present technology, an example in whichthe access point 701 and the information processing devices 703, 704,710, and 720 are connected using the wireless LAN (for example, thewireless LAN corresponding to IEEE 802.11 a/b/g/n/ac/ad) will bedescribed. An example in which the access point 701 and the informationprocessing device 730 are connected via an Ethernet line will bedescribed.

Further, an example in which the information processing devices 703,704, 710, and 720 are assumed to be the transmission side informationprocessing device (source device), and the information processing device730 is assumed to be the reception side information processing device(sink device) will be described. The information processing devices 703,704, 710, and 720 correspond to the information processing device 200illustrated in FIG. 2, and the information processing device 730corresponds to the information processing device 300 illustrated in FIG.3. In the following description, the information processing device 710will be mainly described as the source device, and the descriptionsimilarly applies to the information processing devices 703, 704, and720.

The information processing device 710 is the transmission sideinformation processing device (the source device) that transmits animage. The information processing device 710 is an informationprocessing device that can be connected with the access point 701 in theinfrastructure mode.

Here, a connection example in which the information processing device710 establishes the connection with the access point 701 in theinfrastructure mode will be described. The information processing device710 transmits a connection request signal to the access point 701 inresponse to a beacon signal transmitted from the access point 701. Asdescribed above, the information processing device 710 starts anoperation (a connection establishment operation) for establishing theconnection with the access point 701 by transmitting the connectionrequest signal.

The connection establishment operation is an operation of linking alevel of a layer 2. For example, a connection authentication process ofdetermining whether or not the information processing device 710 isconnected as an application is necessary in addition to passwordauthentication using packet identification (PID) performed in thewireless LAN.

The information processing device 710 can establish the connection withthe information processing device 730 through P2P direct communication(for example, WiFi Direct). For example, the information processingdevice 710 has a protocol capable of establishing the connection withthe information processing device 730 through the WiFi Direct andenabling image communication such as the Wi-Fi CERTIFIED Miracast ordigital living network alliance (DLNA).

The information processing device 710 may be a standby device thatestablishes the connection with the access point 701 and interchangesvarious kinds of information with the information processing device 730via the access point 701. Further, when the information processingdevice 710 is used only as the standby device, the informationprocessing device 710 may not have a protocol capable of enabling imagecommunication.

The information processing device 730 has a communication function forestablishing a connection with the access point 701, the informationprocessing devices 703, 704, 710, and 720, or the control device 740.The information processing device 730 has a function of establishing theconnection with the access point 701, the information processing devices703, 704, 710, and 720, and the control device 740 and controlling allprotocols. The information processing device 730 has a communicationfunction of establishing a connection with a private LAN or a globalLAN.

Here, it is important to stabilize the connection between theinformation processing device 730 and the information processing devices703, 704, 710, and 720. Thus, it is desirable to use a frequencydifferent from a radio frequency used by the access point 701 for theconnection between the information processing device 730 and theinformation processing devices 703, 704, 710, and 720. In the secondembodiment of the present technology, an example in which a frequencyband such as 2.4 GHz, 5 GHz, or 60 GHz of IEEE 802.11 a/b/g/n/ac/ad isused will be described. Here, any other wireless standard or any otherfrequency band may be used.

The information processing device 730 has a display function ofdisplaying an image. The display function is a function of performingscreen display of a television or a projector. The informationprocessing device 730 may cause an image to be displayed on a displayunit with which the information processing device 730 is equipped or maycause an image to be displayed on an external display device. In thesecond embodiment of the present technology, an example in which thedisplay device 731 separate from the information processing device 730is installed will be described.

When the display device 731 separate from the information processingdevice 730 is installed as described above, the information processingdevice 730 and the display device 731 can be connected through wiredconnection or wireless connection. For example, when the informationprocessing device 730 and the display device 731 are connected throughwired connection, the connection can be established using a wirelinecable (for example, High-Definition Multimedia Interface (HDMI)(registered trademark), Mobile High-Definition Link (MHL), DisplayPort,or USB3.0). Further, for example, when the information processing device730 and the display device 731 are connected through wirelessconnection, the connection can be established using the wireless LAN. Aplurality of display devices may be connected to the informationprocessing device 730.

The control device 740 is a connection control device that manages theinformation processing devices (the information processing devices 703,704, 710, 720, and 730) included in the communication system 700 andcontrols the connection of the information processing devices. Forexample, the control device 740 manages and detects information (forexample, terminal identification information and capability information)related to the information processing devices and an operation state(for example, a communication mode and a group participation state) ofthe information processing devices. The control device 740 is connectedwith the information processing device 730 using wireless communication.For example, a communication scheme (for example, the wireless LAN)supported by the information processing device 730 may be used as thewireless communication. An infrared scheme, any other wireless scheme,or a wired line may be used. The control device 740 may have a protocolfor establishing the connection with the access point 701 and establishthe connection with the information processing device 730 via the accesspoint 701.

Installation Example of Communication System

FIG. 18 is a diagram illustrating an installation example of thecommunication system 700 according to the second embodiment of thepresent technology.

FIG. 18 illustrates an example in which the communication system 700 isinstalled in a classroom 30 in a university. In FIG. 18, people areschematically indicated by circles, and a title indicating each personis written in the circle corresponding to that person. For example,there is assumed to be a teacher 1 at a platform side (an upper side inFIG. 18) of the classroom 30, and the teacher 1 is assumed to be usingthe control device 740. A student 1 is assumed to be sitting on a seat31 at a front side of the classroom 30, and the student 1 is assumed tobe using the information processing device 710. Similarly, students 2 to20 are assumed to be sitting on seats 32 to 35 and using the informationprocessing devices 703 to 705 and 720. An entrance 36 is assumed to beinstalled in a rear side (a lower side in FIG. 18) of the classroom 30.

For example, in the classroom 30, the display device 731 is installed atthe platform side to be easily visible to the students 1 to 20 sittingon the seats 31 to 35. The access point 701, the network 702, and theinformation processing device 730 are appropriately installed inside oroutside the classroom 30 in view of space of the classroom 30. In thiscase, the access point 701 is preferably installed in a place in whichwireless communication with the information processing devices used bythe students sitting on the seats 31 to 35 can be performed.

For example, a case in which the students give presentations in theclassroom 30 one by one is assumed. In this case, each student can givea presentation while causing an image related to the presentation to bedisplayed on the display device 731 and visible to the other students.

The teacher 1 can sequentially select the information processing devicesof the students who have to cause the image to be displayed on a displayunit 732 of the display device 731 by manipulating the control device740. A selection example of information processing device will bedescribed in detail with reference to FIG. 21.

A reader/writer device 37 is installed near the entrance 36 of theclassroom 30. The reader/writer device 37 interchanges various kinds ofinformation with the information processing device using the near fieldcommunication (for example, NFC). The reader/writer device 37 transmitsinformation interchanged between the information processing devices tothe information processing device 730 using a wireless line or a wiredline. An example of using the reader/writer device 37 will be describedin a third embodiment of the present technology.

Configuration Example of Control Device

FIG. 19 is a block diagram illustrating a functional configurationexample of the control device 740 according to the second embodiment ofthe present technology.

The control device 740 includes an antenna 741, a wireless communicationunit 742, an input and output unit 743, a manipulation reception unit746, a control unit 747, and a group management information retentionunit 750.

The wireless communication unit 742 transmits and receives each piece ofinformation to and from the information processing device 730 via theantenna 741 using wireless communication under the control of thecontrol unit 747.

The manipulation reception unit 746 is a manipulation reception unitthat receives a manipulation input performed by the user and outputsmanipulation information to the control unit 747 according to thereceived manipulation input. The manipulation reception unit 746 isimplemented by, for example, a keyboard or a mouse.

The input and output unit 743 causes various kinds of images to bedisplayed on a display unit 744 and receives the manipulation input fromthe user through an input unit 745 based on a detection state of anobject that approaches or touches a display surface of the display unit744. The input unit 745 outputs control information according to thereceived manipulation input to the control unit 747.

As described above, the input and output unit 743 is configuredintegrally with the display unit 744 and the input unit 745. The inputand output unit 743 can be integrally configured using a touch panel onwhich the user can perform a manipulation input by touching orapproaching a display surface with his or her finger. Further, forexample, the user can manipulate the control device 740 by performing atouch manipulation (or an approach manipulation) on an image displayedon the display unit 744.

For example, a capacitive (electrostatic capacitive) touch panel thatdetects a touch or an approach of an object (for example, a humanfinger) having conductivity based on a change in capacitance can be usedas the input unit 745. Further, any touch panel other than anelectrostatic (electrostatic capacitive) touch panel may be used. Forexample, a pressure sensitive (resistive) touch panel or an opticaltouch panel may be used.

The control unit 747 controls each unit of the control device 740 basedon a control program. For example, when real-time image transmission isperformed between the sink device and a plurality of source devicesaccording to the Wi-Fi CERTIFIED Miracast specification, the controlunit 747 performs control such that the communication mode is set in thesource device. In this case, the control unit 747 causes an imageindicating a plurality of source devices to be displayed on the inputand output unit 743, and performs control such that the communicationmode is set in the source device based on the manipulation input in theinput and output unit 743. Alternatively, the control unit 747 performscontrol such that the communication mode is set in the source devicebased on a predetermined order. Here, the predetermined order may be,for example, an order of images displayed on a peripheral channel region734 illustrated in FIG. 22 side by side. Further, when there are aplurality of display devices, the control unit 747 may perform controlsuch that all screens are displayed on each display device or aswitching display is performed.

The group management information retention unit 750 is a table thatretains information (group management information) for managing thesource devices connected to the information processing device 730 inunits of groups using wireless communication. Content retained in thegroup management information retention unit 750 will be described indetail with reference to FIG. 20.

Content Example Retained in Group Management Information Retention Unit

FIG. 20 is a diagram schematically illustrating a content exampleretained in the group management information retention unit 750according to the second embodiment of the present technology.

In the group management information retention unit 750, terminalidentification information 751, user information 752, a communicationmode 753, a group participation state 754, an outdoor use 755, and anavailable group participation time 756 are retained in associationtherewith.

In the terminal identification information 751, identificationinformation is stored to identify the source devices connected to theinformation processing device 300 using the wireless communication.

In the user information 752, information (user information) related tothe users owning the source devices connected to the informationprocessing device 300 using wireless communication is stored. Forexample, a name, a nickname, identification information (for example, astudent ID number, an employee ID number, or a membership number), or animage (for example, an image of the user's face or a drawing of theuser's face) of the user may be stored as the user information. The userinformation stored in the user information 752 is displayed on the inputand output unit 743. The user information may be registered in thecontrol device 740, for example, by the user owning the source device.The user information may be registered in the control device 740 eachtime the connection with the information processing device 300 isestablished.

The communication modes set in the source devices connected to theinformation processing device 300 using wireless communication arestored in the communication mode 753. For example, any one of a standbymode, an image transmission mode (a middle channel), and an imagetransmission mode (a peripheral channel) is stored as the communicationmode. The communication modes will be described in detail with referenceto FIG. 22.

Information indicating whether or not the information processing device300 is connected using wireless communication is stored in the groupparticipation state 754. For example, the source device registered inthe control device 740 in advance is also considered not to be connectedto the information processing device 300. Thus, it is possible to detectthe source device that is registered in the control device 740 but notconnected to the information processing device 300 with reference to thegroup participation state 754.

Information indicating whether or not the source device connected to theinformation processing device 300 using wireless communication canperform communication using a base station other than a specific accesspoint is stored in the outdoor use 755. In other words, informationindicating whether or not communication can be performed using thesource device connected to the information processing device 300 usingwireless communication even when the source device moves to a placeother than a specific place is stored in the outdoor use 755.

Information indicating a time zone in which the source device connectedto the information processing device 300 using wireless communicationcan participate in a group is stored in the available groupparticipation time 756. For example, permission may not be given to someuser in a time zone in which a presentation or a conference that ishighly confidential, a presentation or a conference that has a highdegree of importance, a meeting that has not to be exposed, or the likeis performed.

Display Example of Control Device

FIG. 21 is a diagram illustrating an example of a display screendisplayed on the input and output unit 743 of the control device 740according to the second embodiment of the present technology.

The image (the teacher 1 and the students 1 to 20) indicating one ormore information processing devices managed by the control device 740 isdisplayed on the input and output unit 743. A presentation region 748and a standby region 749 are arranged on the input and output unit 743.

FIG. 21 illustrates an example in which the communication system 700 isinstalled in the classroom 30 in a university as illustrated in FIG. 18.In this case, for example, images (for example, icons) indicating theteacher 1 and the students 1 to 20 present in the classroom 30 aredisplayed. In FIG. 21, the text “teacher” and a number identifying ateacher are written in a rectangle corresponding to an image indicatinga teacher. Further, the text “student” and a number identifying astudent are written in a rectangle corresponding to an image indicatinga student. An icon with other information (for example, a student IDnumber, an ID, a face image, a name, or a nickname) identifying astudent may be displayed.

In FIG. 21, an example in which the images indicating the students 1 to20 are arranged in a lattice form in the order of numbers allocated tothe students is illustrated, but the images indicating the students 1 to20 may have any other arrangement. For example, the images indicatingthe students 1 to 20 may be arranged according to positions of therespective students. For example, position information (for example, alatitude and a longitude) of an information processing device owned byeach student may be acquired, and an absolute position of theinformation processing device may be decided based on the positioninformation. It is possible to decide relative positions of theinformation processing devices based on the positions of the informationprocessing devices decided as described above and arrange the students.The information processing devices can acquire the position information,for example, using the Global Positioning System (GPS).

For example, the relative position of the information processing devicemay be detected using radio waves. For example, the informationprocessing device 730 may acquire radio wave strengths from a pluralityof information processing devices and acquire a relative position (aposition of the own information processing device) with the otherinformation processing devices based on the radio wave strengths using atriangulation technique. The control device 740 may acquire the relativepositions obtained as described above and arrange the students.

Here, each of the source devices participating in the group performs,for example, a process of transmitting a command to the access point 701or the information processing device 730 at a level at which powerconsumption is not influenced. When the command is received directly orindirectly via the access point 701, the information processing device730 notifies the control device 740 of information related to the sourcedevice from which the command has been received. Thus, the controldevice 740 can confirm whether or not the source device has left thegroup.

For example, the control device 740 confirms whether or not the sourcedevice participating in the group has left the group, and deletes theimage (for example, the icon) corresponding to the source device thathas left from the input and output unit 743 when the source device thathas left is detected. For example, when the command transmitted from theinformation processing device corresponding to the student 17illustrated in FIG. 21 is determined not to have been received for apredetermined period of time or more, the control device 740 determinesthe information processing device corresponding to the student 17 tohave left the group. Then, the control device 740 deletes the image (thestudent 17) corresponding to the information processing device that hasleft from the input and output unit 743.

The presentation region 748 is a region used when switching from thestandby mode to the image transmission mode (the middle channel or theperipheral channel) is performed.

The standby region 749 is a region used when switching from the imagetransmission mode to the standby mode is performed.

In the second embodiment of the present technology, an example in whichthe control device 740 manages one or more information processingdevices connected to the information processing device 730, and theimages indicating the information processing devices are displayed onthe input and output unit 743 of the control device 740 is described.However, one or more information processing devices connected to theinformation processing device 730 may be managed by the informationprocessing device 730, and the images indicating the informationprocessing devices may be displayed on the display unit of theinformation processing device 730 or the display device 731.

Display Example of Display Device

FIG. 22 is a diagram illustrating a transition example of the displayscreen displayed on the display device 731 according to the secondembodiment of the present technology. FIG. 22 illustrates a transitionexample of the display screen that is switched according to thecommunication mode of the source device.

As described above, in the state in which the source device is connectedwith the sink device (when participation in the group is permitted), thecommunication mode of either of the standby mode and the imagetransmission mode is set in the source device.

Here, the image transmission mode is a communication mode in which imagetransmission from the source device to the sink device is performed, andthe source device and the sink device are directly connected in the P2Pmanner. The image transmission mode includes an image transmission mode(the middle channel) in which an image of the middle channel istransmitted and an image transmission mode (the peripheral channel) inwhich an image of the peripheral channel is transmitted.

The image transmission mode (the middle channel) is a communication modein which image data for causing the image to be displayed on the middlechannel (a middle channel region 733) in the display unit of the sinkdevice is transmitted. In the image transmission mode (the middlechannel), for example, the image data is transmitted through a wirelesstransmission path of a high frequency band.

The image transmission mode (the peripheral channel) is a communicationmode in which image data for causing the image to be displayed on themiddle channel (the peripheral channel region 734) in the display unitof the sink device is transmitted. In the image transmission mode (theperipheral channel), for example, the image data is transmitted throughthe wireless transmission path of the low frequency band.

The standby mode is a communication mode in which the connection statebetween the source device and the sink device via the access point ismaintained with no image transmission from the source device to the sinkdevice. In other words, the standby mode is a mode set when the sourcedevice is recognized as a network participant by the sink device and thecontrol device 740.

As described above, in the image transmission mode, the imagetransmission from the source device to the sink device is assumed to beallowed, but in the standby mode, the image transmission from the sourcedevice to the sink device is assumed not to be allowed. However, even inthe standby mode, transmission from the source device to the sink deviceis assumed to be allowed, for example, when there is simple messaging.

In the source device, the communication mode is assumed to besequentially switched, for example, as in the standby mode→the imagetransmission mode (the peripheral channel)→the image transmission mode(the middle channel)→the standby mode.

In FIG. 22, a illustrates a display example when the standby mode is setin the information processing device 710. For example, in the exampleillustrated in FIG. 17, the standby mode is assumed to be set in theinformation processing device 710. In this case, the informationprocessing device 710 is connected with the information processingdevice 730 via the access point 701. In this case, image transmissionfrom the information processing device 710 to the information processingdevice 730 is not performed. Thus, an image (a running horse) displayedon the information processing device 710 is not displayed on the displayunit 732 of the display device 731.

In FIG. 22, b illustrates a display example when the image transmissionmode (the peripheral channel) is set in the information processingdevice 710. For example, in the example illustrated in FIG. 17, theimage transmission mode (the peripheral channel) is assumed to be set inthe information processing device 710. In this case, the informationprocessing device 710 is connected with the information processingdevice 730 without intervention of the access point 701. In this case,the image transmission from the information processing device 710 to theinformation processing device 730 is performed. The image (the runninghorse) displayed on the information processing device 710 is displayedon the peripheral channel region 734 in the display unit 732 of thedisplay device 731.

Here, the images of the source devices are displayed on the peripheralchannel region 734 in the order in which the images are displayed on themiddle channel region 733. For example, the source device that transmitsan image displayed at the lowest position of the peripheral channelregion 734 serves as the source device that causes the image to bedisplayed on the middle channel region 733 the next time. Further, forexample, the source device that transmits an image displayed at a secondlowest position of the peripheral channel region 734 serves as thesource device that causes the image to be displayed on the middlechannel region 733 the time after that. In other words, the images (subimages) can be displayed on the peripheral channel region 734 side byside in the order of presentations.

In FIG. 22, c illustrates a display example when the image transmissionmode (the middle channel) is set in the information processing device710. For example, in the example illustrated in FIG. 17, the imagetransmission mode (the middle channel) is assumed to be set in theinformation processing device 710. In this case, the informationprocessing device 710 is connected with the information processingdevice 730 without intervention of the access point 701. In this case,image transmission from the information processing device 710 to theinformation processing device 730 is performed. The image (runninghorse) displayed on the information processing device 710 is displayedon the middle channel region 733 in the display unit 732 of the displaydevice 731.

Switching Example of Communication Mode of Source Device

Here, a switching method when the communication modes (the standby modeand the image transmission mode) of the source device are switched willbe described.

For example, the following (B1) to (B3) can be used as triggers forswitching of the communication modes of the source device:

(B1) switching using the source device (for example, active switchingaccording to a manipulation of the user using the source device);

(B2) switching using the control device (for example, switching (remotemanipulation switching) according to a manipulation of the user usingthe control device 740); and

(B3) switching using the sink device (for example, switching accordingto a manipulation of the user using the sink device).

The manipulation (the switching manipulation) of the user in each deviceis, for example, the manipulation of the user using the manipulationreception unit (for example, a manipulation member or a touch panel)with which each device is equipped or the manipulation of the user usingthe user information acquisition unit (for example, a detection unitthat detects a gesture) with which each device is equipped.

In (B1), for example, a manipulation input of an application or amanipulation member installed in the source device in advance can beused as a switching trigger. For example, when the switchingmanipulation is performed in the source device, a command related toswitching of the communication mode is transmitted to the sink device(the information processing device 730). When the command is received,the sink device (the information processing device 730) performs controlsuch that the band of the source device that has transmitted the commandis increased or decreased while performing control for the other bands.The sink device (the information processing device 730) transmitsinformation indicating that the communication mode of the source devicethat has transmitted the command has been switched to the control device740. In this case, the control device 740 may output notificationinformation indicating that the communication mode has been switched(through a display or an audio output).

In (B2), for example, the manipulation of the user in the sink device(the information processing device 730) can be used as the switchingtrigger. For example, when the switching manipulation of the sourcedevice is performed in the sink device (the information processingdevice 730), control is performed such that the band of the sourcedevice in which the switching manipulation has been performed isincreased or decreased while performing control for the other bands. Thesink device (the information processing device 730) transmitsinformation indicating that the communication mode of the source devicein which the switching manipulation has been performed has been switchedto the control device 740. In this case, similarly to the case of (B1),the control device 740 may output notification information indicatingthat the communication mode has been switched.

In (B3), for example, the manipulation of the user in the control device740 can be used as the switching trigger. For example, when theswitching manipulation of the source device is performed in the controldevice 740, information (for example, the terminal identificationinformation) related to the source device in which the switchingmanipulation has been performed is transmitted to the sink device (theinformation processing device 730). When the information is received,the sink device (the information processing device 730) performs controlsuch that the band of the source device in which the switchingmanipulation has been performed is increased or decreased whileperforming control for the other bands.

Here, the manipulation of the user in the control device 740 will bedescribed. For example, in the display screen illustrated in FIG. 21,the information processing device (the student 17) set to the standbymode is assumed to be switched to the image transmission mode (theperipheral channel). In this case, a manipulation of moving the imagecorresponding to the information processing device (the student 17) upto the presentation region 748 is performed. For example, the drag &drop manipulation is performed. As a result, the information processingdevice (the student 17) set to the standby mode can be switched to theimage transmission mode (the peripheral channel).

Further, for example, in the display screen illustrated in FIG. 21, theinformation processing device (the student 13) set to the imagetransmission mode (the middle channel, the peripheral channel) isassumed to be switched to the standby mode. In this case, a manipulationof moving the image corresponding to the information processing device(the student 13) up to the standby region 749 is performed. For example,the drag & drop manipulation is performed. As a result, the informationprocessing device (the student 13) set to the image transmission mode(the middle channel, the peripheral channel) can be switched to thestandby mode.

Similarly to the cases of (B1) and (B2), the control device 740 mayoutput the notification information indicating that the communicationmode has been switched.

The control device 740 may cause the images (for example, the students 1to 20 illustrated in FIG. 21) indicating the information processingdevices to have different display states according to the communicationmode. For example, the contour of the image indicating the informationprocessing device set to the image transmission mode (the middlechannel) is indicated by a thick line, and the contour of the imageindicating the information processing device set to the imagetransmission mode (the peripheral channel) is indicated by a fine line.The information processing device set to the standby mode may beindicated by a dotted line. As another example, the color of the imageindicating the information processing device set to the imagetransmission mode (the middle channel) is red, and the color of theimage indicating the information processing device set to the imagetransmission mode (the peripheral channel) is blue. Further, the colorof the image indicating the information processing device set to thestandby mode may be white.

Switching Example of Communication Mode

FIG. 23 is a diagram illustrating a switching example of thecommunication mode between the source device and the sink device servingas the basis for the present technology.

In the second embodiment of the present technology, a connection schemeof indirectly connecting a source device 610 with a sink device 612 viaan access point 611 is employed in the standby mode as described above.In the image transmission mode, a connection scheme of directlyconnecting the source device 610 with the sink device 612 withoutintervention of the access point 611 is employed.

For example, switching from a connection (613) in the standby mode to aconnection (614) in the image transmission mode is assumed to beperformed. In other words, switching from the standby mode (613) inwhich the connection is established via the access point 611 to theimage transmission mode (614) in which the connection is establishedwithout intervention of the access point 611 is assumed to be performed.

When the switching is performed as described above, it is necessary toperform Wi-Fi direct control (P2P Device Discovery, P2P ServiceDiscovery, and GO Negociation), 4-way handshake (Handshake) forperforming the security authentication of the wireless LAN, dynamic hostconfiguration protocol (DHCP) access for acquiring an Internet protocol(IP) address, interchange of a port setting of a real time streamingprotocol (RTSP), or the like, which are illustrated in FIG. 24. Thus,when switching from the connection (613) in the standby mode to theconnection (614) in the image transmission mode is performed, aconnection period D1 of a time of several seconds occurs.

Here, the access point 611 and the source device 610 are assumed to bein the same group authentication and the source device 610 and the sinkdevice 612 are assumed to be in the same group authentication. In thiscase, the security authentication is performed between the access point611 and the source device 610. For this reason, there is assumed to beno problem even if a set value between the access point 611 and thesource device 610 is used for the connection process between the sourcedevice 610 and the sink device 612.

In this regard, in the second embodiment of the present technology, anexample in which the security authentication between the source deviceand the sink device is omitted, and more seamless connection switchingis performed is described. For example, it is possible to divert aprocess such as IP acquisition of a high-bandwidth digital contentprotection system (HDCP) and a port setting of real-time transportprotocol (RTP). Thus, even when switching to a communication mode havinga different connection scheme (switching from the standby mode to theimage transmission mode and switching from the image transmission modeto the standby mode) is performed, a rapid connection process can beperformed. Thus, it is possible to cause the user to feel as if theconnection were continuously maintained.

Further, when the source device and the sink device support a tunneleddirect link setup (TDLS) function, a TDLS protocol may be used.

Connection Process Example

FIG. 24 is a sequence chart illustrating a connection process examplebetween the source device and the sink device according to the secondembodiment of the present technology. FIG. 24 illustrates a connectionprocess example between the information processing device (the sourcedevice) 710 and the information processing device (the sink device) 730.

First, the information processing device 710 performs the DeviceDiscovery (615). When the information processing device 730 is detectedthrough the Device Discovery, the information processing device 710performs decision of a master-slave relation based on a Formation and anauthentication process with the information processing device 730 (620).When the respective processes are completed, a connection is establishedbetween the information processing device 710 and the informationprocessing device 730. Then, the information processing device 710performs direct communication (Operation) with the informationprocessing device 730 (616).

Here, the Formation (620) will be described.

First, GO_Negotiation is performed between the information processingdevice 710 and the information processing device 730. In GO_Negotiation,the information processing device 710 and the information processingdevice 730 exchange a priority for operating as a group owner (GO), andthe information processing device that has the higher priority isdecided to operate as the group owner (GO). FIG. 24 illustrates anexample in which the priority of the information processing device 730is higher, and the information processing device 730 is decided as thegroup owner (GO).

Specifically, the information processing device 710 transmitsGO_Negotiation_Request to the information processing device 730 (621).Upon receiving GO_Negotiation_Request (621), the information processingdevice 730 transmits GO_Negotiation_Response to the informationprocessing device 710 (622). Upon receiving GO_Negotiation_Response(622), the information processing device 710 transmitsGO_Negotiation_Confirmation to the information processing device 730(623).

Through these interchanges (621 to 623), the information processingdevice 730 is decided as the group owner (GO), and the informationprocessing device 710 is decided as a client.

Then, the information processing device 710 and the informationprocessing device 730 execute Wi-Fi protected access (WPS)_exchange(624). Through the execution of WPS_exchange, the information processingdevice 710 and the information processing device 730 share credentials(for example, a service set identifier (SSID) and a Wi-Fi protectedaccess 2 (WPS2)-pre-shared key (PSK).

Then, the information processing device 710 and the informationprocessing device 730 execute 4-way_handshake (625).

Communication Example

FIGS. 25 and 26 are sequence charts illustrating a communication processexample between devices included in the communication system 700according to the second embodiment of the present technology. FIGS. 25and 26 illustrate a communication process example among the informationprocessing device (the source device) 710, the information processingdevice (the sink device) 730, and the access point 701.

In the example of FIGS. 25 and 26, the information processing device(the sink device) 730 functions as a group authentication server. Inother words, the information processing device (the sink device) 730 isassumed to have a group authentication function.

FIGS. 34 to 38 are diagrams illustrating an example of a WFD IE formatinterchanged between devices included in the communication system 700according to the second embodiment of the present technology.

FIG. 39 is a diagram illustrating an example of a new message for anapplication service platform (ASP) interchanged between devices includedin the communication system 700 according to the second embodiment ofthe present technology.

First, the information processing device 710 activates an application(an application installed in the information processing device 710 inadvance) for performing communication with the information processingdevice 730 (631). The activation of the application is performed, forexample, according to a manipulation of the user (for example, amanipulation of pressing an application button).

Here, in the example of FIGS. 25 and 26, the source device is connecteddirectly to the access point and then starts each process as a default.In other words, the information processing device 710 activates anapplication that is installed in advance, and transmits a connectionrequest to the sink device (the information processing device 730) via aspecific access point (the access point 701).

Specifically, after establishing the connection with the access point701, the information processing device 710 performs the device discovery(corresponding to the Device Discovery (615) illustrated in FIG. 24),and causes a connectable sink device to be displayed on the display unit711.

Here, for example, a method of receiving a message such as a ProbeRequest and performing the device discovery so that the WiFi directprotocol can be executed via the access point 701 may be used as thedevice discovery method. Further, for example, a method of interchanginga device service type represented by a universal plug and play (UPnP)between stations connected to the access point 701 and performing thedevice discovery may be used.

Here, an example of a control method of the Device Discovery or theService Discovery will be described.

The information processing device 710 (the source device) transmits theProbe Request to the information processing device 730 (the sink device)via the access point 701, and searches for a device that supports a P2Pconnection.

For example, when the information processing device 730 (the sinkdevice) is the device that supports the P2P connection, it is possibleto receive a Probe Response via the access point 701 and detect afrequency channel used in the P2P connection. Here, the description willproceed under the assumption that the information processing device 730(the sink device) is the device that supports the P2P connection, andthe Probe Response has been received.

Through the above process, the information processing device 710 (thesource device) detects the frequency channel for the P2P connection, andestablishes the P2P connection with the information processing device730 (the sink device).

After the P2P connection is established, the information processingdevice 710 (the source device) establishes a link of a TCP connection oran RTSP connection with the information processing device 730 (the sinkdevice), and then interchanges one or more of the following (C1) to (C4)with the information processing device 730:

(C1) P2P information element (IE);

(C2) WFD IE;

(C3) ASP (for example, a new format according to a format command of theASP); and

(C4) a protocol in the UPnP standard.

For example, a method of encapsulating the WFD IE in a payload portionof the Probe Request or the Probe Response and interchanging the WFD IEwill be described.

A format example using the WFD IE of (C2) described above is illustratedin FIGS. 34 to 38. FIGS. 34 to 36 illustrate a format that is alreadyallocated in Miracast Release 1. However, a new bit is allocated to asubelement ID (11) illustrated in FIG. 36. Specifically, a new fieldcorresponding to the subelement ID (11) is illustrated in FIGS. 37 and38.

In FIG. 38, [5:0] of a New Device Information field is information thatenables the information processing device 730 (the sink device) todetermine an optimum frequency channel in the P2P connection.

In the process of the sequence using any one of (C1) to (C3) describedabove, the information processing device 710 (the source device) candetect all information and determine the optimum frequency channel inthe P2P connection with the information processing device 730 (the sinkdevice). For example, associated frequency information (a field of[23:14] illustrated in FIG. 38) between the access point 701 and theinformation processing device 730 (the sink device) may be used.Further, for example, concurrent information (a field of [5:2]illustrated in FIG. 38) of a wireless line of the information processingdevice 730 (the sink device) may be used. The concurrent information isinformation indicating whether or not connection forms such as a timedivision connection of the same frequency channel, a time divisionconnection of different frequency channels, a simultaneous connection ofthe same frequency channel, and a simultaneous connection of differentfrequency channels are possible (the field of [5:2] illustrated in FIG.38). For example, a terminal capability serving as a radio function (afield of [13:8] illustrated in FIG. 38) may be used.

There are cases in which the access point 701 and the informationprocessing device 730 (the sink device) are connected in a wired manneror by a connector such as an Ethernet cable or a USB cable/connector. Inthis case, the information processing device 730 (the sink device) givesa notification indicating that the connection with the access point 701is a wired connection ([1:0] illustrated in FIG. 38) and whether awireless P2P connection is supported by the information processingdevice 710 (the source device). Thus, the information processing device710 (the source device) can determine the optimum frequency channel. Forexample, when the information processing device 730 (the sink device)supports only the wired line, the information processing device 730 (thesink device) establishes the connection with the access point 701without change and without transitioning to the P2P connection. On theother hand, when the information processing device 730 (the sink device)supports the wireless line as well, the information processing device730 (the sink device) can select one of supported frequency channels andestablish the connection.

The example of encapsulating the WFD IE in the payload portion of theProbe Request or the Probe Response has been described above, but thepresent technology is not limited to this example.

For example, when a Display Service of Wi-Fi Direct Services is used,Service Capability information can be exchanged between devices througha message of the ASP standard. Specifically, information included in theWFD IE is delimited in units of 4 bits, converted into a hexadecimalnumber, and converted into a text string, and the text string istransmitted and received. Further, the information included in the WFDIE is not limited to a current specification. For example, the ServiceCapability information illustrated in FIG. 39 may be included in thepayload.

A negotiation of the associated frequency information and the concurrentinformation of the device may be performed as a series of processes ofthe Device Discovery or the Service Discovery. Further, the negotiationof the associated frequency information and the concurrent informationof the device may be performed again when it is necessary to change thefrequency channel during transmission. Further, when the negotiationstarts, any one of (C1) to (C4) that can be interchanged is negotiatedbetween the information processing device 710 (the source device) andthe information processing device 730 (the sink device), and a method ofinterchanging information may be selected.

In the above-described processes, the example in which the informationprocessing device 710 (the source device) receives the Probe Response,then establishes the TCP connection or the RTSP connection of the P2Pconnection link, and then interchanges (C1) to (C4) has been described.However, the Probe Request and the Probe Response including the WFD IEmay be interchanged using the TCP connection or the RTSP connection inwhich the information processing device 710 (the source device) and theinformation processing device 730 (the sink device) are connected viathe access point 701 before the P2P connection link is established. Inthis example, the process is initiated by the information processingdevice 710 (the source device), but the process may be initiated by theinformation processing device 730 (the sink device).

Further, regardless of the above-described processes, the frequency forestablishing the P2P connection may be described in the Probe Request,and the frequency channel for transmitting the Probe Response from theinformation processing device 730 (the sink device) may not be thefrequency channel used by the Probe Request. The reception may beperformed through the P2P connection.

In the embodiment of the present technology, the example in which thedevice discovery is performed immediately after the application isactivated has been described, but the present technology is not limitedto this example. For example, at least one of the source device and thesink device may have an NFC tag function or a reader/writer function. Inthis case, the control method of the Device Discovery or the ServiceDiscovery may start at a timing at which any one device using the NFC istouched through the NFC. Further, it may be determined whether or not aconnection to the access point starts at a timing at which it is touchedthrough the NFC. Furthermore, a criterion for selecting (C1) to (C4)described above may be performed between the information processingdevice 710 (the source device) and the information processing device 730(the sink device) through the NFC. For example, an NFC touch timing maybe used for switching of the following (D1) and (D2):

(D1) at a touch timing, an access point is disconnected, and directconnection is established; and

(D2) connection is established by TDLS at a touch timing.

A plurality of sink devices corresponding to the activated applicationmay also be discovered through the device discovery process. In thiscase, a selection screen for selecting a desired sink device from aplurality of discovered sink devices may be displayed on the displayunit of the source device, and the desired sink device may be selectedon the selection screen by the manipulation of the user. A deviceclosest to the source device among a plurality of discovered sinkdevices may be automatically selected and connected. When the closestdevice is automatically selected, for example, the position informationacquired by the respective devices may be used.

As described above, the information processing device 710 activates anapplication, and selects the sink device (631). FIGS. 25 and 26illustrate an example in which the information processing device 730 isselected.

When the sink device (the information processing device 730) is selectedas described above (631), the control unit (corresponding to the controlunit 240 illustrated in FIG. 2) of the information processing device 710transmits the connection request to the sink device (the informationprocessing device 730) via the access point 701 (632 to 635). Theconnection request includes, for example, identification information(for example, the terminal identification information 391 illustrated inFIG. 4) identifying the information processing device 710 andidentification information (application information) identifying anapplication to be activated.

Upon receiving the connection request from the information processingdevice 710 (635), the control unit (corresponding to the control unit370 illustrated in FIG. 3) of the information processing device 730performs a group authentication process (636). In the groupauthentication process, it is determined whether or not the informationprocessing device 710 participates in the group operated by theapplication activated by the information processing device 710 (636). Inother words, the control unit of the information processing device 730performs the group authentication process for determining whether or nota connection for operating the application activated by the informationprocessing device 710 is permitted to the information processing device710 (636).

For example, in the group authentication process, it is determinedwhether or not the manipulation of the user for giving the permission tothe information processing device 710 has been performed in any one ofthe source device, the sink device, and the control device 740 thatbelong to the same group and are already in the connection state. Then,a determination for permitting the information processing device 710 toparticipate in the group can be performed under the condition that themanipulation of the user for giving the permission to the informationprocessing device 710 have been performed in any one of the devices (thesource device, the sink device, and the control device 740).

For example, a display screen (for example, pop-up) for performing themanipulation of the user for giving the permission to the informationprocessing device 710 is displayed on the display unit of at least oneof the devices (the source device, the sink device, and the controldevice 740). Then, when the manipulation of the user for giving thepermission to the information processing device 710 is performed ondisplay screen, the control unit of the information processing device730 determines to permit the information processing device 710 toparticipate in the group (636).

The group authentication process may be performed, for example, based onthe presence or absence of registration in the control device 740. Forexample, the control unit of the information processing device 730determines to permit the information processing device whose terminalidentification information is stored in the terminal identificationinformation 751 (illustrated in FIG. 20) of the group managementinformation retention unit 750 to participate in the group (636).However, in this case, only when it is within the period of time of theavailable group participation time 756 (illustrated in FIG. 20) of thegroup management information retention unit 750, does the control unitof the information processing device 730 determine to give permissionfor participation in the group (636).

When the information processing device 710 is determined to be permittedto participate in the group in the group authentication process (636),the control unit of the information processing device 730 transmitsconnection permission information to the information processing device710 via the access point 701 (637 to 640). Here, the connectionpermission information is information indicating that the informationprocessing device 710 is permitted to participate in the group operatedby the application activated by the information processing device 710.

Further, when the information processing device 710 is determined not tobe permitted to participate in the group in the group authenticationprocess (authentication is not permitted) (636), the control unit of theinformation processing device 730 transmits connection non-permissioninformation to the information processing device 710 via the accesspoint 701. Here, the connection non-permission information isinformation indicating that the information processing device 710 is notpermitted to participate in the group operated by the applicationactivated by the information processing device 710. When the informationprocessing device 710 receives the connection non-permissioninformation, the operation of the data transmission process ends.

Upon receiving the connection permission information from theinformation processing device 730 (640), the control unit of theinformation processing device 710 transmits the capability informationrelated to the information processing device 710 to the informationprocessing device 730 via the access point 701 (641 to 644). Thecapability information is capability information for performing Wi-FiCERTIFIED Miracast communication with the information processing device730. The capability information includes information for performingdirect P2P connection with the information processing device 730.

Upon receiving the capability information from the informationprocessing device 710 (644), the control unit of the informationprocessing device 730 transmits setting request information to theinformation processing device 710 via the access point 701 (645 to 648).The setting request information is information for requesting a settingfor performing the image transmission according to the Wi-Fi CERTIFIEDMiracast standard.

Here, the information processing device 730 performs band control anddisplay screen control for the source devices connected with theinformation processing device 730. For this reason, it is necessary torequest a newly connected information processing device 710 to transmita setting of a parameter in which group sharing is considered based on arelation with other source devices. In this regard, after theinformation processing device 710 is permitted to participate in thegroup, the information processing device 730 transmits the settingrequest information related to the information processing device 710based on each piece of information related to each of the source devicesconnected with the information processing device 730 (645 to 648).

Further, as described above, in the information processing device 710,the standby mode is initially set based on an instruction given from theinformation processing device 730. In other words, when the settingrequest information is received from the information processing device730 (648), in the information processing device 710, the standby mode isset as an initial state.

Further, based on an instruction given from the information processingdevice 730, in the information processing device 710, the communicationmode is sequentially switched, for example, in the order of the standbymode→the image transmission mode (the peripheral channel)→the imagetransmission mode (the middle channel)→the standby mode.

Here, the communication mode of the information processing device 710 isassumed to be switched according to the switching method of any one of(B1) to (B3) described above. Here, an example in which thecommunication mode of the information processing device 710 is switchedfrom the standby mode to the image transmission mode (the peripheralchannel) is described.

When the image transmission mode is set as described above (649), thecontrol unit of the information processing device 710 disconnects accessto the information processing device 730 via the access point 701 (650and 651).

Then, the control unit of the information processing device 710 performsthe P2P connection process for performing direct connection with theinformation processing device 730 (652 and 653). After the P2Pconnection process is completed (652 and 653), the control unit of theinformation processing device 710 transmits the connection request tothe information processing device 730 based on the setting requestinformation received from the information processing device 730 (654 and655). In other words, the control unit of the information processingdevice 710 transmits the connection request to the informationprocessing device 730 based on the setting request information receivedfrom the information processing device 730 (654 and 655). The connectionrequest is a connection request related to a connection setting of up toa layer 3.

Upon receiving the connection request (655), the control unit of theinformation processing device 730 transmits confirmation informationindicating permission for reception of an image corresponding to theconnection request to the information processing device 710 (656 and657). Upon receiving the confirmation information (657), the controlunit of the information processing device 710 starts the direct P2Pconnection with the information processing device 730 (658 and 659).

In other words, the control unit of the information processing device710 performs a negotiation of an image parameter and an audio parameterwith the information processing device 730 based on the connectionrequest corresponding to the received confirmation information, andtransmits the image data (658 and 659).

Here, the communication mode of the information processing device 710 isassumed to be switched according to the switching method of any one of(B1) to (B3) described above. Here, an example in which thecommunication mode of the information processing device 710 is switchedfrom the image transmission mode (the middle channel) to the standbymode is described.

When the standby mode is set as described above (660), the control unitof the information processing device 710 disconnects the directconnection with the information processing device 730 (661 and 662).

Then, the control unit of the information processing device 710 performsthe connection process for performing the connection with theinformation processing device 730 via the access point 701 (663, 664).

Further, when switching between the direct connection and the connectionvia the access point 701 is performed, the connection period of time maybe detected in advance, and the image lastly displayed on the displaydevice 731 may be retained in the sink device (the informationprocessing device 730) without change. Then, the sink device (theinformation processing device 730) performs the connection switchingduring a process of changing a display position in the display device731. In other words, the sink device performs an interpolation processso that the disconnection is not recognized by the user. Thus, theswitching can be performed while preventing the user from feeling aswitching period of time that physically occurs.

Operation Example of Information Processing Device (Source Device)

FIG. 27 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the second embodiment of the present technology.FIG. 27 illustrates an example in which the source device (theinformation processing device 710) is directly connected to the accesspoint and then starts each process as default. In other words, theinformation processing device 710 activates an application that isinstalled in advance, and transmits the connection request to the sinkdevice via a specific access point (the access point 701). Further, FIG.27 illustrates an example in which the source device (the informationprocessing device 710) is connected to the information processing device730 serving as the sink device and connected to the access point 701serving as a specific access point.

First, the information processing device 710 activates an applicationfor performing communication with the sink device (the informationprocessing device 730) (step S1031). After the activation, the sinkdevice (the information processing device 730) serving as a connectiontarget is selected (step S1031).

Then, the control unit of the information processing device 710transmits the connection request to the information processing device730 via the access point 701 (AP) (step S1032). Then, the control unitof the information processing device 710 determines whether or not theconnection permission information has been received from the informationprocessing device 730 via the access point 701 (step S1033). When theconnection permission information has not been received from theinformation processing device 730 (step S1033), the operation of thedata transmission process ends. In this case, the operation of the datatransmission process may end when the connection permission informationhas not been received within a predetermined period of time.

When the connection permission information has been received from theinformation processing device 730 (step S1033), the control unit of theinformation processing device 710 transmits the capability informationof the information processing device 710 to the information processingdevice 730 via the access point 701 (step S1034).

Then, the control unit of the information processing device 710determines whether or not the setting request information has beenreceived from the information processing device 730 via the access point701 (step S1035). Step S1035 is an example of a second process set forthin the claims. When the setting request information has not beenreceived (step S1035), it is continuously monitored.

When the setting request information has been received (step S1035), inthe information processing device 710, the standby mode is set as theinitial state. Then, the control unit of the information processingdevice 710 determines whether or not the standby mode has been set (stepS1036). Then, when the standby mode has been set in the informationprocessing device 710 (step S1036), it is continuously monitored.

When the standby mode has not been set (when the image transmission modehas been set) (step S1036), the control unit of the informationprocessing device 710 determines whether or not the informationprocessing device 710 has left the group (step S1037). Here, when theinformation processing device 710 has left the group, for example, whenthe information processing device 710 has moved to a place that neitherthe radio waves of the access point nor the sink device reaches, amanipulation of the user for leaving the group may be performed. Thismanipulation of the user may be, for example, a manipulation of pressinga leaving button (for example, a manipulation of pressing themanipulation member or a manipulation of pressing the touch panel). Themanipulation of the user is assumed to be performed in any one of theinformation processing device 710, another source device, the sinkdevice, and the control device 740.

Then, when the information processing device 710 has left the group(step S1037), the operation of the data transmission process ends. Whenthe information processing device 710 has not left the group (stepS1037), the control unit of the information processing device 710disconnects the connection with the information processing device 730via the access point 701 (step S1038).

Then, the control unit of the information processing device 710 performsthe P2P connection process for performing the direct connection with theinformation processing device 730 (step S1039). After the P2P connectionprocess is completed (step S1039), the control unit of the informationprocessing device 710 transmits the connection request to theinformation processing device 730 based on the setting requestinformation received from the information processing device 730 (stepS1040). Step S1040 is an example of a third process set forth in theclaims.

Then, the control unit of the information processing device 710determines whether or not the confirmation information indicatingpermission for reception of an image corresponding to the connectionrequest has been transmitted from the information processing device 730(step S1041). When the confirmation information has not been transmittedfrom the information processing device 730 (step S1041), it iscontinuously monitored.

When the confirmation information has been transmitted from theinformation processing device 730 (step S1041), the control unit of theinformation processing device 710 starts the direct P2P connection withthe information processing device 730 (step S1042). Then, the controlunit of the information processing device 710 performs the negotiationof the image parameter and the audio parameter with the informationprocessing device 730 based on the connection request corresponding tothe received confirmation information, and transmits the image data(step S1043). Step S1043 is an example of a first process set forth inthe claims.

Then, the control unit of the information processing device 710determines whether or not the image transmission mode has been set (stepS1044). Then, when the image transmission mode has been set in theinformation processing device 710 (step S1044), the process returns tostep S1043.

When the image transmission mode has not been set (when the standby modehas been set) (step S1044), the control unit of the informationprocessing device 710 determines whether or not the line has beendisconnected (step S1045). For example, when the information processingdevice 710 has left the group, the line with the access point 701 or theinformation processing device 730 is disconnected. Then, when the linehas been disconnected (step S1045), the operation of the datatransmission process ends.

When the line is not disconnected (step S1045), the control unit of theinformation processing device 710 disconnects the direct connection withthe information processing device 730 (step S1046). Then, the controlunit of the information processing device 710 starts the connection withthe access point 701 (step S1047).

As described above, the information processing device 710 performsreal-time image transmission with the information processing device 730according to the Wi-Fi CERTIFIED Miracast specification. The controlunit of the information processing device 710 performs control such thatsetting request information for causing the information processingdevice 710 to perform a setting related to the real-time imagetransmission is received from the information processing device 730 viathe access point 701. Further, the control unit of the informationprocessing device 710 performs control such that a setting request forperforming a setting based on the setting request information istransmitted to the information processing device 730 through the directcommunication with the information processing device 730. The settingrequest information is generated based on the capability information(related to the information processing device 710) interchanged betweenthe information processing device 710 and the information processingdevice 730 via the access point 701.

Further, when the connection state is switched, the control unit of theinformation processing device 710 can perform control such that theconnection process is performed using at least one of port informationand IP information related to a connection before the switching. Theswitching of the connection state is switching from the connection statewith the information processing device 730 via the access point 701 tothe connection state with the information processing device 730 by thedirect communication or inverse switching.

In the image transmission mode (the peripheral channel), the controlunit of the information processing device 710 performs control such thatan image to be displayed on the peripheral channel region 734 in thedisplay device 731 is transmitted through the wireless transmission pathof the low frequency band. In the image transmission mode (theperipheral channel), the control unit of the information processingdevice 710 performs control such that an image to be displayed on themiddle channel region 733 in the display device 731 is transmittedthrough the wireless transmission path of the high frequency band.

The control unit of the information processing device 710 performscontrol such that the setting request is transmitted to the informationprocessing device 730 through the direct communication based on themanipulation of the user in any one of the devices. Alternatively, thecontrol unit of the information processing device 710 performs controlsuch that the setting request is transmitted to the informationprocessing device 730 through the direct communication in apredetermined order (for example, the order of images displayed on theperipheral channel region 734 side by side).

The control unit of the information processing device 730 performscontrol such that the setting request information for causing theinformation processing device 710 to perform the setting related to thereal-time image transmission is transmitted to the informationprocessing device 710 via the access point 701. Further, the controlunit of the information processing device 730 performs control such thatthe setting request for performing a setting based on the settingrequest information is received from the information processing device710 through the direct communication with the information processingdevice 710.

When switching between the access point and the direct connection isperformed as described above, the switching period of time can bereduced. For example, in an environment in which the band control isperformed on a plurality of source devices, an Infrastructureenvironment, and a WiFi Direct (or the Wi-Fi CERTIFIED Miracast)environment, the switching period of time can be reduced. Thus, theseamless connection switching can be provided.

In a multi-source environment, it is possible to set a connection orderand share image information of a high-quality image while causing aplurality of source devices to participate in the group. For example, itis possible to notify the sink device (or the control device) of thesource device that participates in an Infrastructure environment. In theWiFi Direct (or Wi-Fi CERTIFIED Miracast) environment, it is possible toperform the image transmission through the direct communication througha frequency channel different from that in the Infrastructureenvironment. Thus, even when a plurality of source devices are connectedto a single display device (sink device), stable image communication canbe performed. Further, even when hardly any of the source devices areswitched to the image transmission mode due to wireless bandrestrictions, all connections can be stably established.

As the number of connected devices in the group increases, the overheadof connection control increases, band usage efficiency gets worse, andthus it is difficult to perform image transmission stably. On the otherhand, in the embodiment of the present technology, it is possible toprovide the communication system capable of performing stable imagetransmission even in the environment in which the number of connecteddevices is large. In other words, in the embodiment of the presenttechnology, it is possible to perform appropriate control whencommunication is performed between a plurality of information processingdevices.

Example in which Connection with Public Line Other than InitiallyConnected Access Point can be Established

In the above example, when the source device is connected to the sinkdevice, the connection with the sink device via the access point or thedirect connection with the sink device is performed. Here, the userusing the source device may move when the source device is a portableinformation processing device (for example, a smartphone or a tabletterminal). In this case, for example, the user using the source devicemay also move to a place in which it is difficult to establish theconnection with the access point. In this case, the user may desire tocontinuously perform the connection with the sink device. In thisregard, an example in which the user using the source device moves to aplace in which it is difficult to establish the connection with theaccess point will be described below.

Usage Example of Source Device

FIG. 28 is a diagram illustrating a usage example of the informationprocessing device 710 according to the second embodiment of the presenttechnology.

FIG. 28 schematically illustrates an example in which the student 1using the information processing device 710 in the classroom 30illustrated in FIG. 18 moves to the outside of the classroom 30 asindicated by an arrow 40. For example, the student 1 may move from theclassroom 30 in which a presentation has been given to a laboratory or aplace outside a university. Further, for example, in the case of anoffice, a salesman may go out of a conference room in which apresentation has been given.

In FIG. 28, a range (a radio wave arrival range from the access point701) in which direct communication with the access point 701 can beperformed using wireless communication is indicated as a radio wavearrival range 705. A range (a radio wave arrival range from a basestation 762) in which direct communication with the base station 762 canbe performed using wireless communication is indicated as a radio wavearrival range 763.

The public network 761 is a public line network such as a telephonenetwork or the Internet. The network 702 and the base station 762 areconnected via, for example, the public network 761.

The base station 762 is a base station operated by a communicationservice provider, and connects the information processing device withthe public network 761 using wireless communication and provides variouskinds of wireless services. The wireless service is, for example, ahotspot service of IEEE 802.11 or a line service that conforms to IEEE802.15, IEEE 802.16, 3GPP specifications (for example, W-CDMA, GSM,WiMAX, WiMAX2, LTE, and LTE-A).

Operation Example of Information Processing Device (Source Device)

FIGS. 29 and 30 are flowcharts illustrating an example of a processingprocedure of the data transmission process performed by the informationprocessing device 710 according to the second embodiment of the presenttechnology. FIGS. 29 and 30 illustrate an example in which, as adefault, after the source device (the information processing device 710)is directly connected to the access point, the source device (theinformation processing device 710) starts each process and can also beconnected to a public line other than the access point. The exampleillustrated in FIGS. 29 and 30 is a modified example of FIG. 27, and adescription of parts that are common to FIG. 27 is partially omitted.

First, an application is activated (step S1051), and the connectionrequest is transmitted to the information processing device 730 via theaccess point 701 (AP) (step S1052). Then, the control unit of theinformation processing device 710 determines whether or not theconnection permission information has been received from the informationprocessing device 730 via the access point 701 (step S1053). When theconnection permission information has not been received from theinformation processing device 730 (step S1033), the operation of thedata transmission process ends. Steps S1051 to S1053 correspond to stepsS1031 to S1033 illustrated in FIG. 27.

When the connection permission information has been received from theinformation processing device 730 (step S1053), the control unit of theinformation processing device 710 determines whether or not information(outdoor use information) for giving permission for outdoor use isincluded in the connection permission information (step S1054). Theoutdoor use information is permission information indicating whether ornot the connection with the information processing device 730 via theaccess point other than the access point 701 or the base station ispermitted and stored in the outdoor use 755 (illustrated in FIG. 20) ofthe group management information retention unit 750. Further, when theinformation processing device 730 transmits the connection permissioninformation in response to the connection request received via theaccess point 701 (AP), the information processing device 730 acquiresthe outdoor use information (permission or non-permission) from thecontrol device 740, includes the acquired outdoor use information(permission or non-permission) in the connection permission information,and transmits the resulting connection permission information. Further,although “permission” is stored in the outdoor use 755, when it is atime zone other than a time zone stored in the available groupparticipation time 756 (illustrated in FIG. 20), the informationprocessing device 730 includes the outdoor use information of thenon-permission in the connection permission information and transmitsthe resulting connection permission information. In other words, thecontrol device 740 can perform scheduling (schedule management), managescheduled participation times, and permit the outdoor use only in thetime zone. The outdoor use information may be included in the capabilityinformation and transmitted from the sink device to the source device.

Further, when the outdoor use information of the permission is includedin the connection permission information and transmitted, theinformation processing device 730 includes setting information for usingthe public network in a place that the radio waves of the access point701 do not reach in the connection permission information.

In this example, the permission or the non-permission for the outdooruse is set in advance, but the permission or the non-permission may beset in each device each time there is the connection request from thesource device. For example, the manipulation for setting the permissionor the non-permission can be performed using at least one of the othersource devices (for example, the information processing devices 703,704, and 720), the sink device (the information processing device 730),and the control device 740.

For example, the information processing device 730 can cause a displayscreen for selecting the permission or the non-permission to bedisplayed on the input and output unit 743 of the control device 740 andreceive a selection manipulation of the permission or the non-permissionperformed on the display screen.

Further, for example, the information processing device 730 can causethe display screen for selecting the permission or the non-permission tobe displayed on the display unit 732 of the display device 731 andreceive the selection manipulation of the permission or thenon-permission using the display screen. For example, the selectionmanipulation of the permission or the non-permission can be receivedthrough a manipulation input using the manipulation member or amanipulation input based on a gesture.

Further, for example, the information processing device 730 causes thedisplay screen (for example, pop-up) for selecting the permission or thenon-permission to be displayed on a display unit 721 of another sourcedevice (for example, the information processing device 720). Then, theinformation processing device 730 can receive the selection manipulationof the permission or the non-permission performed on the display screen.

As described above, the permission or the non-permission can be set eachtime there is the connection request from the source device. Thus, forexample, even when confidentiality or a degree of importance isdifferent, the permission or the non-permission can be appropriatelyset.

In this example, the sink device functions as the group authenticationserver, and performs management of determining whether or not the sinkdevice gives permission for the outdoor use. However, a managementdevice (for example, a management server) that manages the permissionand the non-permission of the outdoor use in association with the sourcedevice may be newly installed, and the management of determining whetheror not permission for the outdoor use is given may be performed throughthe management device.

When the outdoor use information for giving the permission for theoutdoor use is included in the connection permission information (stepS1054), the control unit of the information processing device 710 causesinformation indicating that the outdoor use is permitted to be displayedon the display unit 711 (step S1055). For example, informationindicating that the use within the same floor (the range that the radiowaves of the access point 701 reach) and the outdoor use are permittedcan be displayed in a pop-up manner, and the user can be notified of it.

Then, the control unit of the information processing device 710transmits the capability information related to the informationprocessing device 710 and public network service information to theinformation processing device 730 via the access point 701 (step S1056).Here, the public network service information is information that enablesthe information processing device 710 to use a public network service,and includes, for example, a connection destination telephone number (atelephone number of the information processing device 710), anauthentication password, or the like.

Then, the control unit of the information processing device 710 performsa communication process (step S1057). In the communication process, theprocess (steps S1035 to S1047) illustrated in FIG. 27 is performed.

Then, the control unit of the information processing device 710determines whether or not the user has moved to the outside of the radiowave transfer range of the access point 701 (step S1058). Then, when theuser has not moved to the outside of the radio wave transfer range ofthe access point 701 (step S1058), the process returns to step S1057.

When the user has moved to the outside of the radio wave transfer rangeof the access point 701 (step S1058), the control unit of theinformation processing device 710 confirms whether or not the userdesires the outdoor use continuously (step S1059). For example, the usermay perform an operation (for example, a communication end manipulation)of disconnecting the connection with the sink device. Thus, it isconfirmed whether or not the user desires the outdoor use continuously.

For example, the control unit of the information processing device 710causes a pop-up screen including information indicating that the userhas moved to the outside of the radio wave transfer range of the accesspoint 701 and a selection button for selecting whether or not the userdesires the outdoor use continuously to be displayed on the display unit711. Then, the control unit of the information processing device 710determines whether or not the selection button for selecting thecontinuous outdoor use has been pressed on the pop-up screen (stepS1059). In other words, the control unit of the information processingdevice 710 determines whether or not the continuous use in a place aftermovement has been selected (step S1059). When the continuous use in theplace after the movement has not been selected (step S1059), theoperation of the data transmission process ends.

As described above, when the outdoor use information (permissioninformation) for giving the permission for the outdoor use has beenreceived, the control unit of the information processing device 710performs control such that the interchange with the informationprocessing device 730 via the access point other than the access point701 or the base station is performed. In this case, the control unit ofthe information processing device 710 can perform control such that atleast one of image data and audio data is received from the informationprocessing device 730 via the access point other than the access point701 or the base station and output.

In this example, the confirmation of the continuous outdoor use isperformed each time the movement to the outside of the radio wavetransfer range of the access point 701 is detected, but the presence orabsence of the continuous outdoor use may be set in advance. By settingthe presence or absence of the continuous outdoor use in advance asdescribed above, switching between the use within the same floor and theoutdoor use can be automatically performed seamlessly.

When the continuous use in the place after the movement is selected(step S1059), the information processing device 730 performs theconnection process via the base station installed in the place after themovement (step S1060). For example, the control unit of the informationprocessing device 730 determines whether or not the informationprocessing device 710 has moved to the outside of the radio wavetransfer range of the access point 701. Then, when the informationprocessing device 710 has moved to the outside of the radio wavetransfer range of the access point 701, the control unit of theinformation processing device 730 performs the connection process forestablishing the connection with the information processing device 710via the base station installed in the place after the movement. Forexample, when the telephone number is included in the public lineservice information received from the information processing device 710,the control unit of the information processing device 730 originates acall to the information processing device 710 via the public networkbased on the telephone number. Then, the control unit of the informationprocessing device 710 performs the connection process with theinformation processing device 730 via the public network.

Here, when the user has moved to the outside of the radio wave transferrange of the access point 701, the user owning the informationprocessing device 710 may not view the display unit 732 of the displaydevice 731 and audio output from the display device 731 may be hardlyaudible. In this regard, the information processing device 730 performsan interchange for confirming whether or not the information processingdevice 710 can receive an image and audio at a point in time at whichthe connection with the information processing device 710 is establishedvia the public network. Then, the information processing device 730determines whether the information processing device 710 can receiveboth or either of the image and the audio.

Based on the determination result, the information processing device 730performs the data communication (the image data and the audio data) withthe information processing device 710. In other words, the control unitof the information processing device 710 performs the data communication(the image data and the audio data) with the information processingdevice 730 via the public network. In the data communication, a two-wayinterchange is performed between the information processing device 710and the information processing device 730.

For example, the control unit of the information processing device 730transmits at least one of the display screen displayed on the displayunit 732 of the display device 731 and the audio output from the displaydevice 731. In the case of outdoor places, it may be difficult to viewthe display screen displayed on the display unit 711 of the informationprocessing device 710. In this case, only the audio may be transmitted.Data to be transmitted can be configured to be modified by the user ofthe information processing device 710.

Further, when the two-way data interchange is performed between theinformation processing device 710 and the information processing device730, the information processing device 730 may confirm a transmissionpath (for example, a band or a communication state) to the informationprocessing device 710 via the public network. Then, the informationprocessing device 730 may switch data to be transmitted based on theconfirmation result. For example, when a large-capacity transmissionpath is secured, the information processing device 730 transmits both ofthe image data and the audio data. Further, for example, when thelarge-capacity transmission path is not secured, the informationprocessing device 730 reduces an amount of image data by transcoding ortransmits only the audio data.

Then, the control unit of the information processing device 710determines whether or not the connection with the information processingdevice 730 via the public network is continuously used (step S1062). Forexample, the control unit of the information processing device 710causes a display screen for selecting whether or not the connection withthe information processing device 730 via the public network iscontinuously used to be displayed (consistently or regularly) on thedisplay unit 711. Then, based on the selection manipulation in thedisplay screen, the control unit of the information processing device710 can determine whether or not the connection with the informationprocessing device 730 via the public network is continuously used.

When the connection with the information processing device 730 via thepublic network is continuously used (step S1062), the process returns tostep S1061. When the connection with the information processing device730 via the public network is not continuously used (step S1062), thecontrol unit of the information processing device 710 disconnects theconnection with the information processing device 730 via the publicnetwork (step S1063).

When the outdoor use information indicating that the outdoor use is notpermitted is included in the connection permission information (stepS1054), the control unit of the information processing device 710 causesinformation indicating that the outdoor use is not permitted to bedisplayed on the display unit 711 (step S1064).

Then, the control unit of the information processing device 710transmits the capability information related to the informationprocessing device 710 to the information processing device 730 via theaccess point 701 (step S1065).

Then, the control unit of the information processing device 710 performsthe communication process (step S1066). In the communication process,the process (steps S1035 to S1047) illustrated in FIG. 27 is performed.

Then, the control unit of the information processing device 710determines whether or not the user has moved to the outside of the radiowave transfer range of the access point 701 (step S1067). Then, when theuser has not moved to the outside of the radio wave transfer range ofthe access point 701 (step S1067), the process returns to step S1066.When the user has moved to the outside of the radio wave transfer rangeof the access point 701 (step S1067), the process proceeds to stepS1063.

As described above, when the sink device and a plurality of sourcedevices share information, the information can be interchangedregardless of the position of the source device. For example, even whenthe student 1 owning the information processing device 710 has moved tothe outside of the radio wave arrival range 705 of the access point 701,the information processing device 710 can be connected to theinformation processing device 730 via the base station. For example, thestudent 1 may move from the classroom 30 in which a presentation hasbeen given to a laboratory or a place outside a university. Further, forexample, when the communication system 700 is installed in an office, asalesman may go out of a conference room in which a presentation hasbeen given. In this case, the salesman can listen to details of aconference outside (for example, in a train).

In the second embodiment of the present technology, the example in whichthe group authentication between the source device and the sink devicestarts when the source device is connected to the access point or thebase station has been described. However, a device having an NFCreader/writer function may start the group authentication between thesource device and the sink device in collaboration with the sink deviceor another device. Another such device is, for example, a device thatconforms to the Wi-Fi CERTIFIED Miracast specification. An example inwhich the group authentication between the source device and the sinkdevice starts using the NFC reader/writer function will be described ina third embodiment of the present technology.

3. Third Embodiment

In the second embodiment of the present technology, the example in whichthe group authentication between the source device and the sink devicestarts when the source device is connected to the access point or thebase station initially has been described.

In the third embodiment of the present technology, an example in whichthe group authentication between the source device and the sink devicestarts using the near field communication will be described. Forexample, the group authentication can start using a Wi-Fi Direct overNFC protocol or a Wi-Fi direct using NFC protocol. For example, thegroup authentication can be initiated by the source device having theNFC function touching the sink device having the NFC function directly.

The Wi-Fi Direct over NFC protocol is a protocol for connecting thesource device and the sink device by touching between the source deviceand the sink device. The protocol is, for example, a protocol forinterchanging information for connecting Wi-Fi Direct by causing thesource device with the NFC tag to touch (or approach) the sink deviceequipped with the NFC reader/writer function.

As described above, the group authentication can be initiated by theoperation of the user of causing the source device to touch the sinkdevice directly. Thus, when the user intends to participate in thegroup, the user can actively perform an operation for participating inthe group. Further, switching to the connection with the access pointcan be performed after the direct connection between the source deviceand the sink device. Accordingly, it is possible to provide auser-friendly interface.

In the second embodiment of the present technology, the example inwhich, when a plurality of sink devices are discovered through thedevice discovery, the selection screen for selecting a desired sinkdevice is displayed, and the user selects the desired sink device on theselection screen has been described. On the other hand, in the thirdembodiment of the present technology, it is possible for the user tocause the source device to be connected to a desired sink device byperforming the operation of causing the source device to touch thedesired sink device.

The group authentication may be initiated by causing the source deviceto touch another device instead of touching the sink device directly.For example, in the example illustrated in FIG. 18, the groupauthentication may be initiated by causing the source device to touchthe reader/writer device 37 installed near the entrance 36 of theclassroom 30. In this case, the reader/writer device 37 transmitsinformation (for example, terminal identification information or apersonal identification number (PIN) code) related to the touched sourcedevice to the sink device. For the PIN code, a unique ID that isindependently generated is preferably used.

Further, for example, a remote controller for manipulating the sinkdevice (for example, the information processing device 730) or thedisplay device (for example, the display device 731) may be used as thesink device. For example, the group authentication may be initiated bycausing the source device to touch the remote controller equipped withthe NFC reader/writer function. In this case, the remote controllertransmits information (for example, the terminal identificationinformation or the PIN code) related to the touched source device to thesink device.

Operation Example of Information Processing Device (Source Device)

FIG. 31 is a flowchart illustrating an example of a processing procedureof the data transmission process performed by the information processingdevice 710 according to the third embodiment of the present technology.FIG. 31 illustrates an example in which the group authentication isinitiated by causing the information processing device 710 to touch theinformation processing device 730 directly. The example illustrated inFIG. 31 is a modified example of FIG. 27, and a description of partsthat are common to FIG. 27 is partially omitted.

In FIG. 31, the information processing device 710 is assumed to have anNFC tag function, and the information processing device 730 is assumedto have an NFC reader/writer function. However, the NFC tag function andthe NFC reader/writer function may be implemented in either of thesource device and the sink device. The information processing device 730functions as a DHCP server.

First, the control unit of the information processing device 710determines whether or not the information processing device 710 touchesthe information processing device 730 (step S1071). When the informationprocessing device 710 does not touch the information processing device730 (step S1071), it is continuously monitored.

When the information processing device 710 touches the informationprocessing device 730 (step S1071), the control unit of the informationprocessing device 710 starts the direct connection with the informationprocessing device 730 (step S1072). In other words, the informationprocessing device 710 functions as a P2P client, and the informationprocessing device 730 functions as a P2P GO. Then, the control unit ofthe information processing device 710 receives a wireless parameter fromthe information processing device 730, and performs the connectionprocess based on the received wireless parameter (step S1073).

Then, the control unit of the information processing device 710 acquiresan IP address from the information processing device 730 (DHCP server)(step S1074).

Then, the control unit of the information processing device 710determines whether or not the connection permission information has beenreceived from the information processing device 730 (step S1075). Whenthe connection permission information has not been received from theinformation processing device 730 (step S1075), the operation of thedata transmission process ends.

When the connection permission information has been received from theinformation processing device 730 (step S1075), the control unit of theinformation processing device 710 transmits the capability informationrelated to the information processing device 710 to the informationprocessing device 730 (step S1076).

Then, the control unit of the information processing device 710determines whether or not the setting request information has beenreceived from the information processing device 730 (step S1077). Whenthe setting request information has not been received (step S1077), itis continuously monitored.

When the setting request information has been received (step S1077), inthe information processing device 710, the image transmission mode isset as the initial state. Then, the control unit of the informationprocessing device 710 transmits the connection request to theinformation processing device 730 based on the setting requestinformation received from the information processing device 730 (stepS1078).

Then, the control unit of the information processing device 710determines whether or not the confirmation information indicatingpermission for reception of an image corresponding to the connectionrequest has been received from the information processing device 730(step S1079). When the confirmation information has not been receivedfrom the information processing device 730 (step S1079), it iscontinuously monitored.

When the confirmation information has been received from the informationprocessing device 730 (step S1079), the control unit of the informationprocessing device 710 starts the direct P2P connection with theinformation processing device 730 (step S1080). Then, the control unitof the information processing device 710 performs the negotiation of theimage parameter and the audio parameter with the information processingdevice 730 based on the connection request corresponding to the receivedconfirmation information, and transmits the image data (step S1081).

Then, the control unit of the information processing device 710determines whether or not the image transmission mode has been set (stepS1082). Then, when the image transmission mode has been set in theinformation processing device 710 (step S1082), the process returns tostep S1081.

Then, the control unit of the information processing device 710determines whether or not the information processing device 710 has leftthe group (step S1083). Then, when the information processing device 710has left the group (step S1083), the operation of the data transmissionprocess ends.

When the information processing device 710 has not left the group (stepS1083), the control unit of the information processing device 710receives AP connection information from the information processingdevice 730 (step S1084). The AP connection information is informationfor disconnecting the connection between the information processingdevice 710 and the information processing device 730 and connecting theinformation processing device 710 with the access point 701.

Then, the control unit of the information processing device 710disconnects the direct connection with the information processing device730 (step S1085). Then, the control unit of the information processingdevice 710 performs the connection process for establishing theconnection with the information processing device 730 via the accesspoint 701 (step S1086).

Then, the control unit of the information processing device 710determines whether or not the confirmation information indicating thatthe connection is permitted has been received from the informationprocessing device 730 via the access point (step S1087). When theconfirmation information has not been received from the informationprocessing device 730 (step S1087), it is continuously monitored.

When the confirmation information has been received from the informationprocessing device 730 (step S1087), the connection with the informationprocessing device 730 via the access point 701 is established. Then, thecontrol unit of the information processing device 710 determines whetheror not the standby mode has been set (step S1088). Then, when thestandby mode has been set in the information processing device 710 (stepS1088), it is continuously monitored.

When the standby mode has not been set (when the image transmission modehas been set) (step S1088), the control unit of the informationprocessing device 710 determines whether or not the line has beendisconnected (step S1089). Then, when the line has been disconnected(step S1089), the operation of the data transmission process ends.

When the line is not disconnected (step S1089), the control unit of theinformation processing device 710 disconnects the connection with theinformation processing device 730 via the access point 701 (step S1090),and the process returns to step S1078.

As described above, the control unit of the information processingdevice 710 can perform control such that the information for performingthe direct communication is interchanged using the near fieldcommunication (for example, NFC).

For example, it may be determined whether or not a touch manipulation onthe information processing device 730 is valid based on whether or notthe touch manipulation is registered in the control device 740. Forexample, for the information processing device whose terminalidentification information is stored in the terminal identificationinformation 751 (illustrated in FIG. 20) of the group managementinformation retention unit 750, the control unit of the informationprocessing device 730 determines the touch manipulation to be valid andgives permission for participation in the group. However, in this case,the control unit of the information processing device 730 determines togive permission for participation in the group only when it is withinthe period of time of the available group participation time 756(illustrated in FIG. 20) of the group management information retentionunit 750. A period of time to participate in the group after the touchmanipulation may be limited to a predetermined period of time. Forexample, it is possible to participate in the group only in a conferencetime zone (for example, within one hour after touching). After apredetermined period of time elapses after touching, another session keymay be used.

As described above, it is possible to easily perform a connectionsetting between the source device and the sink device using the NFC.Thus, for example, the user can intuitively activate a conferenceparticipation trigger and participate in a conference more simply.

4. Fourth Embodiment

In the second and third embodiments of the present technology, theexample in which the source device is connected to the sink device orthe access point through the manipulation of the user or the operationof the user has been described.

Here, the source device may be connected to the access point or the sinkdevice using the wireless LAN, and then the connection may bedisconnected. In this case, the connection setting of the wireless LANmay be stored in the source device even after the connection isdisconnected. In this case, the source device may be automaticallyconnected to the access point or the sink device even if the user owningthe source device does not perform a setting manipulation for connectionor the like.

In this regard, in the fourth embodiment of the present technology, anexample in which the source devices are automatically connected to theaccess point or the sink device will be described. In an environment inwhich the source device is automatically connected to the access pointor the sink device, there may be a plurality of access points connectedto various kinds of sink devices. Thus, by continuously maintaining theconnection of the source device to the plurality of access pointsthrough soft handover, such an environment is implemented.

First, an example in which the source device is automatically connectedto the access point will be described. For example, a case in which itis automatically connected to a private wireless LAN continuously isassumed.

Operation Example of Information Processing Device (Source Device)

FIG. 32 is a flowchart illustrating an example of a processing procedureof a data transmission process performed by the information processingdevice 710 according to the fourth embodiment of the present technology.The example illustrated in FIG. 32 is a modified example of FIG. 27,parts that are common to FIG. 27 are denoted by the same referencenumerals, and thus a description thereof is partially omitted.

First, the information processing device 710 is automatically handedover and connected to the access point installed in the place in whichthe information processing device 710 is located (step S1100). Forexample, the user owning the information processing device 710 may moveto a specific floor to participate in the group. In this environment,the information processing device 710 activates an application (stepS1101). After the activation, the control unit of the informationprocessing device 710 attempts the device discovery process for a sinkdevice that is desired to be connected.

A plurality of sink devices corresponding to the activated applicationmay be discovered through the device discovery process. In this case,the selection screen for selecting a desired sink device from aplurality of discovered sink devices may be displayed on the displayunit 711 of the information processing device 710, and the desired sinkdevice may be selected on the selection screen by the manipulation ofthe user (step S1102). A device closest to the source device among aplurality of discovered sink devices may be automatically selected andconnected (step S1102).

Next, an example in which the source device is automatically connectedto the sink device and access point will be described. For example, theconnection setting of the sink device is assumed to be stored in thesource device, and the source device is assumed to move into the radiowave arrival range of the sink device and be automatically connected tothe sink device.

Operation Example of Information Processing Device (Source Device)

FIG. 33 is a flowchart illustrating an example of a processing procedureof the data transmission process performed by the information processingdevice 710 according to the fourth embodiment of the present technology.The example illustrated in FIG. 33 is a modified example of FIG. 27,parts that are common to FIG. 27 are denoted by the same referencenumerals, and thus a description thereof is partially omitted.

First, the control unit of the information processing device 710determines whether or not the information processing device 710 has aconcurrent function (a time division concurrent function or asimultaneous use concurrent function) as a wireless LAN function (stepS1111). When the information processing device 710 has the concurrentfunction, the information processing device 710 can establish the timedivision connection or the simultaneous connection with both of theaccess point and the sink device without performing disconnectionswitching of the access point and the sink device.

When the information processing device 710 has the concurrent function(step S1111), the control unit of the information processing device 710performs a setting (a setting up to acquisition of an IP address) up toa layer 3 through the automatic connection (step S1112). Then, thecontrol unit of the information processing device 710 makes an attemptto establish the connection with the sink device via the access point(step S1113). Here, when the connection with the sink device isestablished based on both links of the connection via the access pointand the direct P2P connection, it is desirable that the device discoveryprocess be performed through only one of the connection via the accesspoint and the direct P2P connection. For example, a priority may begiven to the connection via the access point, only link connection maybe maintained for the direct P2P connection, and the image transmissionaccording to the Wi-Fi CERTIFIED Miracast may be stopped. In this case,in the image transmission mode, a high-speed operation can be performedduring a next switching period of time without wasting the frequencyband used in the Wi-Fi CERTIFIED Miracast.

When the information processing device 710 has no concurrent function(step S1111), the control unit of the information processing device 710confirms the connection state with the sink device (step S1114). Here,for example, when the connection with the sink device is the direct P2Pconnection, the direct P2P connection is first disconnected, andswitching to the connection via the access point is performed. Further,when the connection with the sink device is the connection via theaccess point, the connection is maintained. Further, when theinformation processing device 710 has no concurrent function, the portinformation and the IP information of the connection state are retainedin the information processing device 710 and diverted.

Then, the control unit of the information processing device 710 performsthe device discovery process via the access point (step S1115). Afterthe device discovery process, the control unit of the informationprocessing device 710 determines whether or not the connectionpermission information has been received from the sink device via theaccess point (step S1116).

Here, in an environment in which the number of participating devices issmall, direct P2P connection may be maintained without change. In thiscase, when the connection permission information has been received fromthe sink device via the access point (step S1116), the process proceedsto step S1038.

As described above, it is possible to appropriately detect the currentsetting information without the user worrying about the connectionsetting. Further, it is possible to perform association so that the sameoperation as in the second embodiment of the present technology isperformed.

The present technology is not limited to the embodiments of the presenttechnology. For example, a device connected in the Wi-Fi infrastructuremode may cause the device discovery to be performed on only a device(for example, a device that conforms to the Wi-Fi CERTIFIED Miracastspecification) connected to the same IP sub network. Further, the devicehaving the concurrent function, for example, the device connected in theWi-Fi infrastructure mode, can be a device that performs a concurrentprocess of the same channel in the P2P manner.

In the embodiments of the present technology, transmission of an image(video) or audio via the access point is not considered, but the presenttechnology is not limited to this example. For example, the embodimentsof the present technology can be applied even to the followingenvironment. For example, the embodiments of the present technology canbe applied to a form in which the source device transmits an image(video) or audio to the sink device connected to the same IP sub networkin the Wi-Fi infrastructure mode via an IP network of the Wi-Fiinfrastructure mode. Further, for example, the embodiments of thepresent technology can be applied to a form in which the sink devicereceives an image (video) or audio from the source device connected tothe same IP sub network in the Wi-Fi infrastructure mode via an IPnetwork of the Wi-Fi infrastructure mode.

5. Application Examples

The technology of the present disclosure can be applied to variousproducts. For example, the information processing device 200, 300, 400,703, 704, 710, 720, 730, and the control device 740 may be realized as amobile terminal such as a smartphone, a tablet-type personal computer(PC), a notebook PC, a portable game terminal, or a digital camera, afixed-type terminal such as a television receiver set, a printer, adigital scanner, or a network storage, or an in-vehicle terminal such asa car navigation device. In addition, the information processing device200, 300, 400, 703, 704, 710, 720, 730, and the control device 740 maybe realized as a terminal which performs machine-to-machine (M2M)communication (which is also referred to as a machine-type communication(MTC) terminal) such as a smart meter, a vending machine, a remotemonitoring device, or a point-of-sale (POS) terminal. Furthermore, theinformation processing device 200, 300, 400, 703, 704, 710, 720, 730,and the control device 740 may be a wireless communication module (forexample, an integrated circuit module configured in one die) mounted inthese terminals.

5-1. First Application Example

FIG. 40 is a block diagram showing an example of a schematicconfiguration of a smartphone 900 to which the technology of the presentdisclosure may be applied. The smartphone 900 includes a processor 901,a memory 902, a storage 903, an external connection interface 904, acamera 906, a sensor 907, a microphone 908, an input device 909, adisplay device 910, a speaker 911, a wireless communication interface913, an antenna switch 914, an antenna 915, a bus 917, a battery 918,and an auxiliary controller 919.

The processor 901 may be, for example, a central processing unit (CPU)or a system on a chip (SoC), and controls functions of an applicationlayer and another layer of the smartphone 900. The memory 902 includes arandom access memory (RAM) and a read only memory (ROM), and stores aprogram that is executed by the processor 901, and data. The storage 903may include a storage medium such as a semiconductor memory or a harddisk. The external connection interface 904 is an interface forconnecting an external device such as a memory card or a universalserial bus (USB) device to the smartphone 900.

The camera 906 includes an image sensor such as a charge coupled device(CCD) and a complementary metal oxide semiconductor (CMOS), andgenerates a captured image. The sensor 907 may include a group ofsensors such as a measurement sensor, a gyro sensor, a geomagneticsensor, and an acceleration sensor. The microphone 908 converts soundsthat are input to the smartphone 900 to audio signals. The input device909 includes, for example, a touch sensor configured to detect touchonto a screen of the display device 910, a keypad, a keyboard, a button,or a switch, and receives an operation or an information input from auser. The display device 910 includes a screen such as a liquid crystaldisplay (LCD) and an organic light-emitting diode (OLED) display, anddisplays an output image of the smartphone 900. The speaker 911 convertsaudio signals that are output from the smartphone 900 to sounds.

The wireless communication interface 913 supports one or more ofwireless LAN standards such as IEEE 802.11a, 11b, 11g, 11n, 11ac, and11ad to execute wireless communication. The wireless communicationinterface 913 can communicate with another device via a wireless LANaccess point in an infrastructure mode. In addition, the wirelesscommunication interface 913 can directly communicate with another devicein an ad hoc mode or a direct communication mode such as Wi-Fi direct,or the like. In the Wi-Fi Direct, unlike the ad-hoc mode, one of twoterminals operates as an access point, but communication is performeddirectly between the terminals. The wireless communication interface 913can typically include a baseband processor, a radio frequency (RF)circuit, and a power amplifier. The wireless communication interface 913may be a one-chip module in which a memory which stores a communicationcontrol program, a processor which executes the program and a relevantcircuit are integrated. The wireless communication interface 913 maysupport other kinds of wireless communication schemes such as a nearfield wireless communication scheme, a proximity wireless communicationscheme or a cellular communication scheme in addition to the wirelessLAN scheme. The antenna switch 914 switches connection destinations ofthe antenna 915 between a plurality of circuits (for example, circuitsfor different wireless communication schemes) included in the wirelesscommunication interface 913. The antenna 915 has a single or a pluralityof antenna elements (for example, a plurality of antenna elements whichconstitute a MIMO antenna), which are used by the wireless communicationinterface 913 for transmission and reception of radio signals.

It should be noted that the smartphone 900 is not limited to the exampleof FIG. 40 and may include a plurality of antennas (for example, anantenna for a wireless LAN, an antenna for the proximity wirelesscommunication scheme, etc.). In that case, the antenna switch 914 may beomitted from the configuration of the smartphone 900.

The bus 917 connects the processor 901, the memory 902, the storage 903,the external connection interface 904, the camera 906, the sensor 907,the microphone 908, the input device 909, the display device 910, thespeaker 911, the wireless communication interface 913, and the auxiliarycontroller 919 to each other. The battery 918 supplies power to blocksof the smartphone 900 illustrated in FIG. 40 via feeder lines, which arepartially shown as dashed lines in the figure. The auxiliary controller919 operates a minimum necessary function of the smartphone 900, forexample, in a sleep mode.

In the smartphone 900 shown in FIG. 40, the control unit 240, and thecontrol unit 370 described using FIG. 3 may be implemented by thewireless communication interface 913. In addition, at least some ofthese functions may be implemented by the processor 901 or the auxiliarycontroller 919.

The smartphone 900 may operate as a wireless access point (software AP)by executing an access point function at an application level throughthe processor 901. Further, the wireless communication interface 913 mayhave a wireless access point function.

5-2. Second Application Example

FIG. 41 is a block diagram illustrating an example of a schematicconfiguration of a car navigation device 920 to which the technology ofthe present disclosure may be applied. The car navigation device 920includes a processor 921, a memory 922, a global positioning system(GPS) module 924, a sensor 925, a data interface 926, a content player927, a storage medium interface 928, an input device 929, a displaydevice 930, a speaker 931, a wireless communication interface 933, anantenna switch 934, an antenna 935, and a battery 938.

The processor 921 may be, for example, a CPU or a SoC, and controls anavigation function and another function of the car navigation device920. The memory 922 includes RAM and ROM, and stores a program that isexecuted by the processor 921, and data.

The GPS module 924 uses GPS signals received from a GPS satellite tomeasure a position (such as latitude, longitude, and altitude) of thecar navigation device 920. The sensor 925 may include a group of sensorssuch as a gyro sensor, a geomagnetic sensor, and an air pressure sensor.The data interface 926 is connected to, for example, an in-vehiclenetwork 941 via a terminal that is not shown, and acquires datagenerated by the vehicle, such as vehicle speed data.

The content player 927 reproduces content stored in a storage medium(such as a CD and a DVD) that is inserted into the storage mediuminterface 928. The input device 929 includes, for example, a touchsensor configured to detect touch onto a screen of the display device930, a button, or a switch, and receives an operation or an informationinput from a user. The display device 930 includes a screen such as aLCD or an OLED display, and displays an image of the navigation functionor content that is reproduced. The speaker 931 outputs sounds of thenavigation function or the content that is reproduced.

The wireless communication interface 933 supports one or more ofwireless LAN standards such as IEEE 802.11a, 11b, 11g, 11n, 11ac, and11ad to execute wireless communication. The wireless communicationinterface 933 can communicate with another device via a wireless LANaccess point in an infrastructure mode. In addition, the wirelesscommunication interface 933 can directly communicate with another devicein an ad hoc mode or a direct communication mode such as Wi-Fi Direct.The wireless communication interface 933 can typically include abaseband processor, an RF circuit, and a power amplifier. The wirelesscommunication interface 933 may be a one-chip module in which a memorywhich stores a communication control program, a processor which executesthe program and a relevant circuit are integrated. The wirelesscommunication interface 933 may support other kinds of wirelesscommunication schemes such as a near field wireless communicationscheme, a proximity wireless communication scheme or a cellularcommunication scheme in addition to the wireless LAN scheme. The antennaswitch 934 switches connection destinations of the antenna 935 between aplurality of circuits included in the wireless communication interface933. The antenna 935 has a single or a plurality of antenna elements,which are used by the wireless communication interface 933 fortransmission and reception of radio signals.

In addition, the car navigation device 920 may include a plurality ofantennas, not limited to the example of FIG. 41. In that case, theantenna switches 934 may be omitted from the configuration of the carnavigation device 920.

The battery 938 supplies power to blocks of the car navigation device920 illustrated in FIG. 41 via feeder lines that are partially shown asdashed lines in the figure. The battery 938 accumulates power suppliedform the vehicle.

In the car navigation device 920 illustrated in FIG. 41, the controlunit 240 described using FIG. 2 and the control unit 370 described usingFIG. 3 may be implemented by the wireless communication interface 933.At least a part of the functions may also be implemented by theprocessor 921.

The technology of the present disclosure may also be realized as anin-vehicle system (or a vehicle) 940 including one or more blocks of thecar navigation device 920, the in-vehicle network 941, and a vehiclemodule 942. The vehicle module 942 generates vehicle data such asvehicle speed, engine speed, and trouble information, and outputs thegenerated data to the in-vehicle network 941.

The above-described embodiments are examples for embodying the presenttechnology, and matters in the embodiments each have a correspondingrelationship with disclosure-specific matters in the claims. Likewise,the matters in the embodiments and the disclosure-specific matters inthe claims denoted by the same names have a corresponding relationshipwith each other. However, the present technology is not limited to theembodiments, and various modifications of the embodiments may beembodied in the scope of the present technology without departing fromthe spirit of the present technology.

The processing sequences that are described in the embodiments describedabove may be handled as a method having a series of sequences or may behandled as a program for causing a computer to execute the series ofsequences and recording medium storing the program. As the recordingmedium, a hard disk, a CD (Compact Disc), an MD (MiniDisc), and a DVD(Digital Versatile Disc), a memory card, and a Blu-ray disc (registeredtrademark) can be used.

Effects described in the present description are just examples, theeffects are not limited, and there may be other effects.

Additionally, the present technology may also be configured as below.

(1)

An information processing device that performs real-time imagetransmission with another information processing device according to awireless fidelity (Wi-Fi) CERTIFIED Miracast specification, including:

a control unit configured to perform control such that setting requestinformation for performing a setting related to the real-time imagetransmission is received from the other information processing devicevia an access point, and a setting request for performing the settingbased on the setting request information is transmitted to the otherinformation processing device through direct communication.

(2)

The information processing device according to (1),

wherein the control unit interchanges capability information related tothe information processing device with the other information processingdevice via the access point, and

the other information processing device generates the setting requestinformation based on the capability information.

(3)

The information processing device according to (1) or (2),

wherein the control unit performs control such that, when switchingbetween a connection state with the other information processing devicevia the access point and a connection state with the other informationprocessing device through the direct communication is performed, aconnection process is performed using at least one of port informationand IP information related to a connection before the switching.

(4)

The information processing device according to any of (1) to (3),

wherein the control unit performs control such that image transmissionaccording to the Wi-Fi CERTIFIED Miracast specification is performedthrough the direct communication after the setting request istransmitted to the other information processing device.

(5)

The information processing device according to (4),

wherein the control unit performs control such that an image displayedon a predetermined region in a display unit is transmitted through awireless transmission path of a low frequency band, and an imagedisplayed on a region larger than the predetermined region in thedisplay unit is transmitted through a wireless transmission path of ahigh frequency band.

(6)

The information processing device according to any of (1) to (5),

wherein the control unit performs control such that the setting requestis transmitted to the other information processing device through thedirect communication based on a manipulation of a user.

(7)

The information processing device according to any of (1) to (5),

wherein the control unit performs control such that, when there are aplurality of information processing devices configured to perform imagetransmission through the direct communication, the setting request istransmitted to the other information processing device through thedirect communication based on a predetermined order.

(8)

The information processing device according to any of (1) to (7),

wherein the control unit performs control such that permissioninformation indicating whether or not a connection with the otherinformation processing device via an access point other than the accesspoint or a base station is permitted is interchanged via the accesspoint, and when the permission information indicating that theconnection is permitted is received, an interchange with the otherinformation processing device via the access point other than the accesspoint or the base station is performed.

(9)

The information processing device according to (8),

wherein the control unit performs control such that, when the permissioninformation indicating that the connection is permitted is received, atleast one of image data and audio data is received from the otherinformation processing device via the access point other than the accesspoint or the base station and output.

(10)

The information processing device according to any of (1) to (9),

wherein the control unit performs control such that information forperforming the direct communication is interchanged using near fieldcommunication.

(11)

An information processing device that performs real-time imagetransmission with another information processing device according to aWi-Fi CERTIFIED Miracast specification, including:

a control unit configured to perform control such that setting requestinformation for performing a setting related to the real-time imagetransmission is transmitted to the other information processing devicevia an access point, and a setting request for performing the settingbased on the setting request information is received from the otherinformation processing device through direct communication.

(12)

An information processing device, including:

a control unit configured to perform control such that, when real-timeimage transmission is performed between a sink device and a plurality ofsource devices according to a Wi-Fi CERTIFIED Miracast specification,any one communication mode of a standby mode in which the sink deviceand the source devices are connected via an access point and an imagetransmission mode in which the sink device and the source devices areconnected through direct communication is set in the source devices.

(13)

The information processing device according to (12),

wherein the control unit performs control such that an image indicatingthe plurality of source devices is displayed on an input and outputunit, and the communication mode is set in the source device based on anmanipulation input in the input and output unit.

(14)

The information processing device according to (12),

wherein the control unit performs control such that the communicationmode is set in the source device based on a predetermined order.

(15)

An information processing system, including:

a sink device configured to perform real-time image transmission with asource device according to a Wi-Fi CERTIFIED Miracast specification andperform control such that a setting request information for causing thesource device to perform a setting related to the real-time imagetransmission is transmitted to the source device via an access point,and a setting request for performing the setting based on the settingrequest information is received from the source device through directcommunication with the source device; and

a control device configured to perform control such that, when thereal-time image transmission is performed between the sink device andthe plurality of source devices, any one communication mode of a standbymode in which the sink device and the source devices are connected viathe access point and an image transmission mode in which the sink deviceand the source devices are connected through the direct communication isset in the source devices.

(16)

An information processing method, including:

a first process of performing real-time image transmission with anotherinformation processing device according to a Wi-Fi CERTIFIED Miracastspecification;

a second process of receiving setting request information for performinga setting related to the real-time image transmission from the otherinformation processing device via an access point; and

a third process of transmitting a setting request for performing thesetting based on the setting request information to the otherinformation processing device through direct communication.

REFERENCE SIGNS LIST

-   100 communication system-   200 information processing device-   210 antenna-   220 wireless communication unit-   230 control signal reception unit-   240 control unit-   250 image and audio signal generation unit-   260 image and audio compression unit-   270 stream transmission unit-   300 information processing device-   310 antenna-   320 wireless communication unit-   330 stream reception unit-   340 image and audio decompression unit-   350 image and audio output unit-   351 display unit-   352 audio output unit-   360 user information acquisition unit-   370 control unit-   380 control signal transmission unit-   390 management information retention unit-   400 information processing device-   610 source device-   611 access point-   612 sink device-   700 communication system-   701 access point-   702 network-   703 to 705, 710, 720, 730 information processing device-   711, 721 display unit-   731 display device-   732 display unit-   740 control device-   741 antenna-   742 wireless communication unit-   743 input and output unit-   744 display unit-   745 input unit-   746 manipulation reception unit-   747 control unit-   750 group management information retention unit-   900 smartphone-   901 processor-   902 memory-   903 storage-   904 external connection interface-   906 camera-   907 sensor-   908 microphone-   909 input device-   910 display device-   911 speaker-   913 wireless communication interface-   914 antenna switch-   915 antenna-   917 bus-   918 battery-   919 auxiliary controller-   920 car navigation device-   921 processor-   922 memory-   924 GPS module-   925 sensor-   926 data interface-   927 content player-   928 storage medium interface-   929 input device-   930 display device-   931 speaker-   933 wireless communication interface-   934 antenna switch-   935 antenna-   938 battery-   941 in-vehicle network-   942 vehicle module

The invention claimed is:
 1. An information processing device thatperforms real-time image transmission with another informationprocessing device according to a Wi-Fi CERTIFIED Miracast specification,comprising: circuitry configured to receive setting request informationfor performing a setting related to the real-time image transmissionfrom the other information processing device via an access point; andtransmit a setting request for performing the setting based on thesetting request information to the other information processing devicethrough direct communication.
 2. The information processing deviceaccording to claim 1, wherein the circuitry is configured to exchangecapability information related to the information processing device withthe other information processing device via the access point, and theother information processing device generates the setting requestinformation based on the capability information.
 3. The informationprocessing device according to claim 1, wherein the circuitry isconfigured to perform control such that, when switching between aconnection state with the other information processing device via theaccess point and a connection state with the other informationprocessing device through the direct communication is performed, aconnection process is performed using at least one of port informationand IP information related to a connection before the switching.
 4. Theinformation processing device according to claim 1, wherein thecircuitry is configured to perform control such that image transmissionaccording to the Wi-Fi CERTIFIED Miracast specification is performedthrough the direct communication after the setting request istransmitted to the other information processing device.
 5. Theinformation processing device according to claim 4, wherein thecircuitry is configured to perform control such that an image displayedon a predetermined region in a display is transmitted through a wirelesstransmission path of a low frequency band, and an image displayed on aregion larger than the predetermined region in the display istransmitted through a wireless transmission path of a high frequencyband.
 6. The information processing device according to claim 1, whereinthe circuitry is configured to perform control such that the settingrequest is transmitted to the other information processing devicethrough the direct communication based on a manipulation of a user. 7.The information processing device according to claim 1, wherein thecircuitry is configured to perform control such that, when there are aplurality of information processing devices configured to perform imagetransmission through the direct communication, the setting request istransmitted to the other information processing device through thedirect communication based on a predetermined order.
 8. The informationprocessing device according to claim 1, wherein the circuitry isconfigured to perform control such that permission informationindicating whether or not a connection with the other informationprocessing device via an access point other than the access point or abase station is permitted is interchanged via the access point, and whenthe permission information indicating that the connection is permittedis received, an interchange with the other information processing devicevia the access point other than the access point or the base station isperformed.
 9. The information processing device according to claim 8,wherein the circuitry is configured to perform control such that, whenthe permission information indicating that the connection is permittedis received, at least one of image data and audio data is received fromthe other information processing device via the access point other thanthe access point or the base station and output.
 10. The informationprocessing device according to claim 1, wherein the circuitry isconfigured to perform control such that information for performing thedirect communication is interchanged using near field communication. 11.An information processing device that performs real-time imagetransmission with another information processing device according to aWi-Fi CERTIFIED Miracast specification, comprising: circuitry configuredto transmit setting request information for performing a setting relatedto the real-time image transmission to the other information processingdevice via an access point; and receive a setting request for performingthe setting based on the setting request information from the otherinformation processing device through direct communication.
 12. Aninformation processing device, comprising: circuitry configured toperform control such that, when real-time image transmission isperformed between a sink device and a plurality of source devicesaccording to a Wi-Fi CERTIFIED Miracast specification, any onecommunication mode of a standby mode in which the sink device and thesource devices are connected via an access point and an imagetransmission mode in which the sink device and the source devices areconnected through direct communication is set in the source devices. 13.The information processing device according to claim 12, wherein thecircuitry is configured to perform control such that an image indicatingthe plurality of source devices is displayed on a user interface and thecommunication mode is set in the source device based on an manipulationinput to the user interface.
 14. The information processing deviceaccording to claim 12, wherein the circuitry is configured to performcontrol such that the communication mode is set in the source devicebased on a predetermined order.
 15. An information processing system,comprising: a sink device configured to perform real-time imagetransmission with a source device according to a Wi-Fi CERTIFIEDMiracast specification and perform control such that a setting requestinformation for causing the source device to perform a setting relatedto the real-time image transmission is transmitted to the source devicevia an access point, and a setting request for performing the settingbased on the setting request information is received from the sourcedevice through direct communication with the source device; and acontrol device configured to perform control such that, when thereal-time image transmission is performed between the sink device andthe plurality of source devices, any one communication mode of a standbymode in which the sink device and the source devices are connected viathe access point and an image transmission mode in which the sink deviceand the source devices are connected through the direct communication isset in the source devices.
 16. An information processing method,comprising: performing, by an information processing device, real-timeimage transmission with another information processing device accordingto a Wi-Fi CERTIFIED Miracast specification; receiving, by theinformation processing device, setting request information forperforming a setting related to the real-time image transmission fromthe other information processing device via an access point; andtransmitting, by the information processing device, a setting requestfor performing the setting based on the setting request information tothe other information processing device through direct communication.